-- Logs begin at Wed 2021-12-15 18:08:27 UTC, end at Wed 2021-12-15 19:21:35 UTC. -- Dec 15 18:55:05.663882 dv-cinder-812685-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 18:55:05.672605 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 18:55:05 2021] *** Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: nodename: dv-cinder-812685-5-iscsi Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: machine: x86_64 Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: clock source: unix Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: pcre jit disabled Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: detected number of CPU cores: 4 Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: current working directory: / Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: detected binary path: /usr/bin/uwsgi-core Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: your processes number limit is 47680 Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: your memory page size is 4096 bytes Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: detected max file descriptor number: 2048 Dec 15 18:55:05.674597 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: lock engine: pthread robust mutexes Dec 15 18:55:05.676128 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: thunder lock: enabled Dec 15 18:55:05.676128 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 18:55:05.676128 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 18:55:05.720900 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: Python main interpreter initialized at 0x56480768d9c0 Dec 15 18:55:05.720900 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: python threads support enabled Dec 15 18:55:05.720900 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: your server socket listen backlog is limited to 100 connections Dec 15 18:55:05.720900 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: your mercy for graceful operations on workers is 90 seconds Dec 15 18:55:05.721268 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 18:55:05.721357 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: *** Operational MODE: preforking *** Dec 15 18:55:05.721602 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: *** uWSGI is running in multiple interpreter mode *** Dec 15 18:55:05.721602 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: spawned uWSGI master process (pid: 102297) Dec 15 18:55:05.721806 dv-cinder-812685-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 18:55:05.724863 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: spawned uWSGI worker 1 (pid: 102298, cores: 1) Dec 15 18:55:05.724863 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: spawned uWSGI worker 2 (pid: 102299, cores: 1) Dec 15 18:55:05.724863 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 18:55:07.454192 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 18:55:07.454192 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: from cryptography.utils import int_from_bytes Dec 15 18:55:07.454848 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 18:55:07.454848 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: from cryptography.utils import int_from_bytes Dec 15 18:55:07.455370 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 18:55:07.455370 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: from cryptography.utils import int_from_bytes Dec 15 18:55:07.455839 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 18:55:07.455839 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: from cryptography.utils import int_from_bytes Dec 15 18:55:10.049620 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 18:55:10.050183 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 18:55:10.050346 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 18:55:10.050711 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 18:55:10.050804 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 18:55:10.051160 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 18:55:10.051247 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 18:55:10.051334 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.051478 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 18:55:10.052183 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.052367 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 18:55:10.052509 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.052615 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 18:55:10.052830 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.052997 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.053182 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.053350 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.053497 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.053682 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.053820 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.054001 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.054140 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.054334 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.054468 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.054648 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.054741 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.054974 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.055063 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.055298 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.055386 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-5-iscsi {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.055629 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.055718 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.055894 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.055983 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.056212 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.056300 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.056539 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-5-iscsi {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.056632 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.056841 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.056929 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.057188 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.057284 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.057503 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.057593 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.057823 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.057995 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.058132 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.059194 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.059344 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.059466 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.059557 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.059633 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.059633 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.059890 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.059996 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.060083 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.060158 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.060284 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.060369 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.060450 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.060592 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.060678 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.060882 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.060972 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.061217 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.061373 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.061655 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-5-iscsi {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.061746 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.061925 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.062014 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.062240 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.062340 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.062551 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.062645 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.062949 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-5-iscsi {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.063045 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.063259 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.063347 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.063569 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.063666 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.063889 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.063988 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.064208 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.064412 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.064501 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.064604 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.064831 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.064958 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.065174 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.065274 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.065488 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.065579 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.065811 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.065907 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.066115 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.066212 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.066422 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.066505 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.066732 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.066824 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.067050 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.067139 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.067895 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.067986 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.068202 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.068284 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.068455 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.068544 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.068762 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.068846 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.069112 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.069198 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.069433 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.069518 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.069691 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.069786 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.069991 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.070087 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.070243 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.070333 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.070562 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.070645 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.070883 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.070983 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.071176 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.071258 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.071431 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.071521 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.071753 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.071838 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.072071 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.072152 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.072378 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.072479 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.072683 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.072767 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.072990 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.073094 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.073322 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.073413 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.073637 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.073728 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.073949 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.074037 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.074260 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.074351 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.074565 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.074654 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.074883 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.074976 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.075203 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.075296 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.075518 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.075609 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.075827 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.075909 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.076147 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.076237 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.076471 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.076561 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.076780 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.076869 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.077132 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.077231 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.077431 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.077518 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.077739 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.077823 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.078046 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.078139 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.078353 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.078445 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.078672 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.078759 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.078979 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.079067 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.079291 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.079377 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.079546 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.079633 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.079849 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.079939 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.080155 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.080237 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.080471 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.080560 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.080771 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.080853 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.081074 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.081172 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.081404 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.081499 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.081702 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.081784 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.082006 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.082094 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.082312 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.082421 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.082621 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.082725 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.082947 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.083067 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.083250 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.083341 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.083556 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.083638 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.083864 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.083946 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.084171 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.084263 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.084477 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.084602 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.084784 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.084873 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.085122 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.085223 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.085424 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.085514 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.085734 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.085831 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.086041 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.086132 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.086347 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.086453 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.086664 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.086748 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.086969 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.087060 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.087275 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.087365 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.087583 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.087674 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.087889 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.088005 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.088195 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.088285 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.088505 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.088588 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.088812 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.088902 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.089139 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.089223 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.089453 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.089543 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.089755 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.089839 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.090064 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.090147 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.090383 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.090467 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.090691 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.090800 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.090997 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.091090 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.091301 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.091386 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.091607 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.091698 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.091911 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.091993 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.092216 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.092298 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.092519 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.092627 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.092824 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.092918 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.093153 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.093258 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.093457 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.093540 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.093771 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.093853 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.094078 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.094168 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.094379 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.094460 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.094683 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.094789 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.095002 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.095093 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.095313 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.095401 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.095626 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.095715 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.095936 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.096030 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.096257 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 18:55:10.096384 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.096595 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.096678 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.096925 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.097009 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.097269 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.097364 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.097586 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.097675 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.097902 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.097985 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.098228 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.098321 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.098567 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.098778 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.098878 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.099099 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.099184 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.099421 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.099513 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.099755 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.099839 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.100072 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.100161 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.100388 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.100480 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.100704 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.100787 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.101026 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.101168 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.101364 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.101455 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.101681 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.101765 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.102002 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.102085 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.102320 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.102402 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.102631 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.102715 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.102943 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.103034 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.103262 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.103345 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.103593 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.103684 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.103915 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.103997 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.104227 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.104310 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.104546 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.104629 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.104859 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.104954 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.105194 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.105292 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.105510 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.105605 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.105843 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.105925 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.106153 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.106242 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.106464 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.106547 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.106777 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.106860 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.107094 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.107189 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.107408 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.107490 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.107716 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.107799 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.108022 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.108113 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.108327 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.108411 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.108637 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.108721 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.108941 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.109025 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.109285 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.109371 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.109593 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.109685 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.109904 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.109989 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.110223 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.110306 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.110531 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.110614 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.110842 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.110930 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.111152 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.111235 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.111458 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.111550 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.111770 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.111861 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.112081 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.112163 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.112384 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.112480 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.112695 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.112776 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.113003 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.113104 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.113342 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.113442 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.113660 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.113750 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.113965 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.114541 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.114785 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.114943 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.115101 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.115190 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.115409 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.115492 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.115719 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.115813 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.116025 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.116114 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.116333 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.116416 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.116645 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.116724 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.116956 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.117051 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.117294 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.117377 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.117612 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.117703 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.117921 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.118009 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.118240 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.118322 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.118555 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.118640 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.118871 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.118960 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.119177 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.119260 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.119487 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.119616 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.119794 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.119883 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.120104 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.120195 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.120407 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.120489 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.120718 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.120800 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.121026 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.121142 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.121359 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.121442 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.121665 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.121748 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.121970 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.122072 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.122274 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.122357 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.122594 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.122676 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.122904 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.123052 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.123207 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.123297 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.123509 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.123592 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.123813 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.123907 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.124147 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.124237 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.124449 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.124537 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.124753 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.124842 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.125059 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.125206 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.125394 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.125477 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.125742 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.125827 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.126051 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.126133 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.126367 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.126449 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.126678 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.126797 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.126991 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.127081 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.127301 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.127386 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.127612 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.127696 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.127930 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.128018 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.128238 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.128328 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.128550 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.128631 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.128857 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.128939 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.129196 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.129295 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.129510 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.129600 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.130385 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.130486 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.130698 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.130793 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.131011 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.131093 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.131338 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.131421 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.131652 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.131742 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.131974 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.132056 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.132282 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.132367 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.132596 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.132679 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.132912 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.133001 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.133247 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.133332 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.133561 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.133646 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.133880 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.133962 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.134191 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.134274 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.134506 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.134590 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.134816 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.134904 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.135125 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.135207 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.135434 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.135517 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.135745 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.135826 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.136052 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.136133 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.136363 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.136446 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.136666 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.136790 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.136981 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.137074 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.137328 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.137413 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.137640 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.137730 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.137958 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.138049 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.138262 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.138343 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.138857 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.138946 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.139167 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.139258 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.139477 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.139560 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.139789 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.139878 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.140096 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.140187 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.140407 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.140490 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.140717 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.140805 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.141029 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.141130 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.141370 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.141455 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.141680 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.141762 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.141986 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.142069 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.142298 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.142380 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.142607 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.142697 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.142911 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.142995 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.143215 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.143298 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.143522 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.143604 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.143840 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.143939 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.144147 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.144233 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.144452 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.144609 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.144759 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.144843 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.145066 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.145200 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.145434 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.145575 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.145750 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.145839 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.146059 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.146141 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.146365 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.146456 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.146672 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.146755 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.146977 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.147075 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.147301 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.147393 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.147610 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.147693 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.147918 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.148000 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.148224 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.148307 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.148533 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.148623 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.148842 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.148923 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.149179 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.149266 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.149495 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.149578 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.149806 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.149890 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.150132 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.150223 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.150443 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.150534 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.150753 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.150843 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.151063 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.151147 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.151375 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.151457 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.151684 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.151775 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.151997 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.152080 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.152307 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.152388 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.152614 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.152705 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.152925 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.153013 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.153258 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.153342 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.153564 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.153658 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.153875 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.153974 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.154191 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.154274 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.154504 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.154758 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.154849 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.155092 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.155174 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.155408 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.155500 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.155726 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.155807 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.156043 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.156293 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.156375 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.156629 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.156713 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.156949 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.157037 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.157296 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.157389 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.157609 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.157694 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.157918 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.158001 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.158224 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.158307 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.158530 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.158614 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.158842 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.158924 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.159146 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.159243 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.159453 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.159547 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.159757 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.159840 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.160062 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.160152 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.160369 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.160451 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.160673 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.160757 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.161167 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.161399 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.161713 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.161805 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.162032 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.162282 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.162371 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.162640 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.162837 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.162974 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.163284 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.163421 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.163606 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.163916 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.163998 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.164233 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.164540 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.164623 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.164867 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.165153 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.165238 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.165508 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.165736 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.165832 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.166113 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.166270 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.166461 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.166596 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.166772 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.167115 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.167445 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.167789 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.168126 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.168211 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.168462 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.168699 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.168814 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.169186 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.169343 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.169541 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.169867 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.170189 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.170379 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.170505 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.170705 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.170826 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.171044 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.171135 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.171363 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.171453 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.171680 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.171772 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.172046 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.172359 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.172674 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.172983 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.173324 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.173505 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.173655 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.173848 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.174000 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.174175 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.174317 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.174496 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.174824 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.174905 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.175149 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.175450 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.175541 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.175776 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.176045 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.176129 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.176394 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.177185 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.177277 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.177635 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.177966 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.178286 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.178651 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.178786 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.178935 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.179018 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.179251 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.179335 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.179565 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.179657 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.179885 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.179967 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.180200 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.180339 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.180509 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.180593 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.180831 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.183166 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.183269 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.183349 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.183349 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.183501 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.183577 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.183651 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.183651 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.185970 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.186057 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.186141 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.186141 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.186285 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.187650 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.187775 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.187775 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.187932 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188011 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188089 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188164 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188250 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188336 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188426 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188504 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188581 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188663 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188747 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188824 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188890 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.188952 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189014 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189118 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189211 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189211 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189340 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189427 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189504 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189588 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189664 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189740 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189814 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189890 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.189965 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190054 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190133 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190209 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190283 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190354 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190429 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190500 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190577 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190577 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190714 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190791 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190874 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.190950 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191026 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191101 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191176 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191251 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191328 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191405 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191480 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191555 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191631 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191706 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191793 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191870 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.191946 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.192021 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.192096 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.192203 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.192774 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.192843 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.192919 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.192995 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.193071 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.193177 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.193343 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.193498 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.193652 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.193817 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.193979 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.194133 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.194297 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.194449 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.194616 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.194757 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.194946 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.195080 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.195270 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.195394 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.195599 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.195708 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.195907 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.196000 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.196221 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.196306 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.196538 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.196627 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.196850 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.196942 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.197239 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.197340 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.197563 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.197657 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.197878 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.197967 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.198194 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.198277 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.198495 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.198580 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.198806 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.198892 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.199120 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.199212 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.199443 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.199536 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.199736 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.199900 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.200046 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.200227 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.200360 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.200547 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.200676 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.200874 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.200965 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.201215 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.201306 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.201527 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.201616 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.201840 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.201925 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.202149 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.202236 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.202464 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.202551 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.202773 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.202857 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.203095 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.203207 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.203407 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.203525 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.203714 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.203840 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.204025 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.204149 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.204331 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.204464 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.204642 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.204778 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.204954 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.205136 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.205410 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.205544 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.205724 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.205864 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.206038 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.206187 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.206344 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.206474 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.206655 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.206786 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.206966 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.207106 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.207283 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.207413 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.207600 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.207739 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.208430 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.208664 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.208809 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.208945 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.209161 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.209260 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.209402 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.209489 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.209711 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.209795 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.210038 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.210125 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.210346 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.210442 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.210659 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.210742 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.210986 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.211072 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.211296 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.211382 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.211601 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.211686 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.211908 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.212065 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.212232 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.212379 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.212537 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.212692 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.212860 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.213015 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.213314 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.213403 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.213628 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.213713 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.213935 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.214028 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.214274 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.214358 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.214586 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.214672 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.214913 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.215007 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.215246 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.215331 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.215558 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.215644 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.215876 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.215970 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.216180 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.216264 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.216496 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.216580 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.216823 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.216919 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.217141 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.217231 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.217464 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.217550 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.217776 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.217870 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.218091 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.218177 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.218397 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.218540 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.218719 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.218806 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.219044 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.219128 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.219359 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.219456 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.219682 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.219767 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.220006 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.220098 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.220317 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.220403 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.220626 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.220750 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.220952 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.221039 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.221291 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.221378 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.221607 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.221708 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.221919 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.222005 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.222232 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.222317 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.222540 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.222702 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.222844 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.222941 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.223166 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.223251 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.224019 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.224126 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.224347 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.224433 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.224666 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.224751 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.224986 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.225105 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.225319 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.225407 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.225625 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.225720 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.225948 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.226033 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.226255 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.226340 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.226558 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.226642 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.226865 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.226951 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.227173 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.227258 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.227496 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.227581 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.227803 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.227889 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.228123 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.228207 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.228432 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.228516 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.228740 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.228835 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.229046 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.229152 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.229388 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.229486 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.229735 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.229829 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.230041 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.230127 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.230379 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.230546 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.230694 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.230780 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.231002 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.231096 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.231314 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.231408 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.231629 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.231716 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.231939 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.232032 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.232248 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.232342 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.232556 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.232646 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.232869 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.232967 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.233196 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.233296 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.233503 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.233588 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.233811 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.233903 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.234114 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.234199 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.234420 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.234514 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.234727 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.234819 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.235043 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.235130 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.235346 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.235431 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.235648 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.235732 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.235952 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.236038 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.236273 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.236365 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.236578 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.236672 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.236901 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.236986 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.237236 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.237322 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.237543 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.237641 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.237848 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.237934 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.238151 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.238236 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.238495 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.238592 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.238796 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.238885 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.239147 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.239251 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.239463 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.239565 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.239778 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.239869 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.240098 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.240188 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.240407 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.240500 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.240727 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.240872 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.241041 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.241161 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.241378 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.241476 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.241696 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.241781 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.242008 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.242094 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.242326 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.242549 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.242643 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.242882 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.242970 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.243203 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.243299 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.243523 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.243609 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.243842 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.243940 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.244159 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.244245 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.244476 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.244692 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.244785 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.245025 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.245143 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.245382 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.245469 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.245698 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.245793 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.246010 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.246104 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.246324 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.246409 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.246639 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.246739 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.246951 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.247062 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.247266 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.247430 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.247577 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.247722 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.247880 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.248037 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.248183 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.248325 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.248504 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.248658 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.248820 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.248972 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.249156 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.249308 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.249478 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.249642 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.249789 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.249952 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.250104 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.250254 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.250409 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.250712 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.250712 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.251037 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.251258 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.251408 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.251565 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.251710 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.251861 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.252016 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.252161 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.252311 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.252452 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.252536 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.252614 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.252691 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.252825 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.252912 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.253165 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.253256 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.253481 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.253578 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.253792 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.253887 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.254101 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.254188 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.254415 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.254508 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.254756 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.254965 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.255084 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.255284 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.255419 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.255620 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.255739 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.255949 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.256044 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.256276 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.256361 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.256597 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.256690 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.256918 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.257241 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.257331 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.257558 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.257644 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.257864 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.257961 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.258178 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.258273 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.258489 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.258575 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.258797 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.258892 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.259122 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.259234 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.259435 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.259562 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.259752 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.259859 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.260032 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.260163 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.260343 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.260469 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.260651 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.260870 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.260995 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.261313 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.261436 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.261549 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.261660 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.261876 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.261988 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.262195 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.262321 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.262504 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.262624 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.262811 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.263035 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.263161 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264067 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264161 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264242 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264320 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264397 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264483 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264569 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264648 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264886 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.264972 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.265216 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.265323 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.265532 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.265617 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.265862 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.265953 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.266149 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.266242 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.266464 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.266552 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.266774 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.266858 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.267079 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.267171 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.267386 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.267473 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.267695 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.267779 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.268004 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.268090 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.268306 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.268398 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.268618 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.268703 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.268920 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.269005 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.269252 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.269351 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.269564 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.269651 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.269868 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.269953 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.270174 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.270782 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.271011 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.271095 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.271318 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.271464 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.271621 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.271706 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.271926 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.272022 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.272230 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.272322 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.272533 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.272618 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.272837 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.272930 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.273170 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.273260 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.273491 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.273620 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.273787 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.273884 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.274093 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.274189 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.274404 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.274488 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.274710 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.274803 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.275022 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.275106 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.275330 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.275414 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.275633 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.275730 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.275948 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.276202 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.276294 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.276571 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.276673 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.276886 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.276973 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.277222 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.277310 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.277572 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.277674 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.277885 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.277969 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.278195 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.278413 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.278546 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.278798 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.278886 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.279114 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.279200 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.279428 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.279522 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.279742 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.279838 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.280057 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.280143 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.280372 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.280466 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.280676 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.280760 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.280986 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.281070 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.281324 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.281419 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.281635 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.281730 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.281948 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.282033 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.282261 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.282347 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.282573 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.282659 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.282884 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.282970 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.283196 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.283290 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.283508 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.283657 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.283818 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.283906 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.284131 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.284217 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.284442 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.284526 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.284753 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.284850 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.285071 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.285183 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.285417 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.285502 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.285735 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.285834 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.286584 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.286674 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.286939 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.287024 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.287252 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.287346 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.287564 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.287650 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.287884 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.287969 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.288215 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.288315 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.288532 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.288628 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.288842 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.288928 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.289179 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.289289 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.289504 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.289590 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.289818 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.289914 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.290150 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.290239 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.290489 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.290575 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.290818 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.290903 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.291145 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.291243 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.291452 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.291544 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.291771 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.292087 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.292359 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.292456 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.292688 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.292774 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.293009 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.293118 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.293374 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.293460 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.293689 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.293811 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.293997 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.294095 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.294306 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.294391 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.294618 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.294703 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.294947 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.295033 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.295258 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.295341 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.295587 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.295673 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.295907 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.295993 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.296218 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.296304 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.296529 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.296614 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.296840 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.296926 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.297194 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.297294 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.297512 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.297604 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.297826 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.297917 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.298138 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.298223 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.298448 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.298546 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.298762 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.298848 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.299072 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.299156 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.299385 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.299498 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.299745 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.299843 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.300003 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.300089 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.300313 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.300408 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.300637 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.300721 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.300956 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.301048 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.301286 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.301373 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.301637 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.301730 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.301951 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.302046 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.302269 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.302362 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.302581 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.302713 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.302891 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.303004 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.303223 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.303318 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.303537 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.303622 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.303887 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.303995 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.304158 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.304246 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.304470 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.304563 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.304787 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.304881 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.305120 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.305253 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.305456 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.305574 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.305782 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.305921 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.306106 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.306250 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.306433 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.306569 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.306779 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.306877 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.307093 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.307192 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.307411 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 18:55:10.307503 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.307752 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.308065 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.308378 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.308684 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 18:55:10.308929 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 18:55:10.330689 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG oslo_db.sqlalchemy.engines [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 18:55:10.331892 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_db.sqlalchemy.engines [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 18:55:10.396699 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.context [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),415a2223-155c-4f3b-b9fc-3b76c07aa9ed(cell1) {{(pid=102299) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 18:55:10.397147 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.context [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),415a2223-155c-4f3b-b9fc-3b76c07aa9ed(cell1) {{(pid=102298) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 18:55:10.400936 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG oslo_concurrency.lockutils [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 18:55:10.401341 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 18:55:10.402535 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG oslo_concurrency.lockutils [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 18:55:10.402940 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 18:55:10.403328 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG oslo_concurrency.lockutils [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 18:55:10.403779 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 18:55:10.405421 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG oslo_concurrency.lockutils [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 18:55:10.405722 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 18:55:10.416100 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG oslo_db.sqlalchemy.engines [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 18:55:10.417851 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_db.sqlalchemy.engines [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 18:55:10.419619 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_db.sqlalchemy.engines [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 18:55:10.422390 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG oslo_db.sqlalchemy.engines [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 18:55:10.593683 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG oslo_db.sqlalchemy.engines [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 18:55:10.603652 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_db.sqlalchemy.engines [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 18:55:11.004500 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: WARNING keystonemiddleware.auth_token [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 18:55:11.011615 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: WARNING keystonemiddleware.auth_token [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 18:55:11.033620 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: WARNING keystonemiddleware.auth_token [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 18:55:11.040776 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: WARNING keystonemiddleware.auth_token [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 18:55:11.351386 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: WARNING keystonemiddleware.auth_token [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 18:55:11.356607 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: WARNING keystonemiddleware.auth_token [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 18:55:11.361725 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56480768d9c0 pid: 102299 (default app) Dec 15 18:55:11.363799 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:55:11.365616 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002354 Dec 15 18:55:11.366018 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Wed Dec 15 18:55:11 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:55:11.377824 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: WARNING keystonemiddleware.auth_token [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 18:55:11.383145 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: WARNING keystonemiddleware.auth_token [None req-fe573362-2f3b-4c13-ba30-308b6090d72d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 18:55:11.388224 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56480768d9c0 pid: 102298 (default app) Dec 15 18:56:35.885803 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:35.886809 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Dec 15 18:56:35.887211 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:56:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:56:36.308316 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-57d1052b-5e5c-4d77-bf32-bfad224497ca admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:36.337689 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-57d1052b-5e5c-4d77-bf32-bfad224497ca admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.442532 Dec 15 18:56:36.338616 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Dec 15 18:56:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:56:38.749068 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:38.750099 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-a4c4c000-e911-48f2-a4e6-63b76bbcbd9a None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Dec 15 18:56:38.750497 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:56:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:56:38.812465 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-3f361908-0f6d-4384-b1f7-d817884fe0b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "disk": 1, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:38.830806 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 18:56:38.830806 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: warnings.warn(msg) Dec 15 18:56:38.955841 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-3f361908-0f6d-4384-b1f7-d817884fe0b7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.198712 Dec 15 18:56:38.956588 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:56:38 2021] POST /compute/v2.1/flavors => generated 407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:56:39.174405 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-a6d86ec8-2842-4b9d-873e-cc4d8e6b7893 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:39.176747 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 18:56:39.176747 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: warnings.warn(msg) Dec 15 18:56:39.319397 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-a6d86ec8-2842-4b9d-873e-cc4d8e6b7893 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.354433 Dec 15 18:56:39.320007 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Dec 15 18:56:38 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:56:41.762066 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-3f361908-0f6d-4384-b1f7-d817884fe0b7 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:41.763080 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-3f361908-0f6d-4384-b1f7-d817884fe0b7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 15 18:56:41.763498 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:56:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:56:41.880949 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-be92c691-d833-4922-82a0-663d66427699 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:41.902727 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 18:56:41.902727 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: warnings.warn(msg) Dec 15 18:56:41.998460 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-be92c691-d833-4922-82a0-663d66427699 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.228007 Dec 15 18:56:41.999083 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:56:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:56:42.011745 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-441b4fae-d3a9-4ef4-a404-268113420796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:42.013246 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 18:56:42.013246 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: warnings.warn(msg) Dec 15 18:56:42.178263 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-441b4fae-d3a9-4ef4-a404-268113420796 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.170270 Dec 15 18:56:42.178921 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Dec 15 18:56:42 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:56:44.589430 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-be92c691-d833-4922-82a0-663d66427699 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:44.590465 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-be92c691-d833-4922-82a0-663d66427699 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Dec 15 18:56:44.591034 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:56:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:56:44.653424 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-c74bf807-9bcd-4948-9da0-95076ccd2c17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:44.709241 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-c74bf807-9bcd-4948-9da0-95076ccd2c17 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.111403 Dec 15 18:56:44.709859 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:56:44 2021] POST /compute/v2.1/flavors => generated 404 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:56:44.721752 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-2bdea773-cb66-4267-999f-a97f325de5d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:44.808045 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-2bdea773-cb66-4267-999f-a97f325de5d8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084339 Dec 15 18:56:44.808045 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Dec 15 18:56:44 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:56:47.245063 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-c74bf807-9bcd-4948-9da0-95076ccd2c17 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:47.247068 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-c74bf807-9bcd-4948-9da0-95076ccd2c17 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003693 Dec 15 18:56:47.249496 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:56:47 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:56:47.325149 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-c4c00c0f-4aca-438f-bff9-d08a07e983a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:47.420541 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-c4c00c0f-4aca-438f-bff9-d08a07e983a1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161525 Dec 15 18:56:47.421590 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:56:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:56:47.433760 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-a195b4de-e473-4e72-bf88-ff7c5752ef47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:47.519546 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-a195b4de-e473-4e72-bf88-ff7c5752ef47 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089639 Dec 15 18:56:47.520438 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Dec 15 18:56:47 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 18:56:50.003150 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-c4c00c0f-4aca-438f-bff9-d08a07e983a1 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:50.004201 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-c4c00c0f-4aca-438f-bff9-d08a07e983a1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Dec 15 18:56:50.004593 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:56:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 18:56:50.065927 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-aa43bf81-4ebd-4376-a9ed-664cceaf1f2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:50.129214 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-aa43bf81-4ebd-4376-a9ed-664cceaf1f2e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.117728 Dec 15 18:56:50.129960 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:56:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:56:50.142269 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-664216e0-150e-4251-ba7e-f9d850d04127 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:50.213420 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-664216e0-150e-4251-ba7e-f9d850d04127 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074482 Dec 15 18:56:50.214149 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Dec 15 18:56:50 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:56:52.599678 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-aa43bf81-4ebd-4376-a9ed-664cceaf1f2e admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:52.600673 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-aa43bf81-4ebd-4376-a9ed-664cceaf1f2e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Dec 15 18:56:52.601075 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:56:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 18:56:52.660334 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-c3adf666-9f53-4bc8-9a0a-68c1ee7ec8e0 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:52.683084 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-c3adf666-9f53-4bc8-9a0a-68c1ee7ec8e0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075070 Dec 15 18:56:52.683611 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Dec 15 18:56:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 18:56:55.172936 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-aa43bf81-4ebd-4376-a9ed-664cceaf1f2e admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:55.174339 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-aa43bf81-4ebd-4376-a9ed-664cceaf1f2e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Dec 15 18:56:55.174882 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:56:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:56:55.236731 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-23630a73-22d3-4366-a8ee-3824e11f7b3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "vcpus": 1, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:55.308853 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-23630a73-22d3-4366-a8ee-3824e11f7b3f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.125962 Dec 15 18:56:55.309420 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:56:55 2021] POST /compute/v2.1/flavors => generated 402 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:56:55.323905 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-ad9a39f9-1681-4fa0-8a24-96d42316af34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:55.411054 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-ad9a39f9-1681-4fa0-8a24-96d42316af34 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091739 Dec 15 18:56:55.411558 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Dec 15 18:56:55 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:56:58.035543 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-23630a73-22d3-4366-a8ee-3824e11f7b3f admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:56:58.036552 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-23630a73-22d3-4366-a8ee-3824e11f7b3f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Dec 15 18:56:58.037149 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:56:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:56:58.094705 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-106aa5af-57fc-4e02-8322-b9a61a5fa60b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:58.164792 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-106aa5af-57fc-4e02-8322-b9a61a5fa60b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.121441 Dec 15 18:56:58.165289 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:56:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 18:56:58.180029 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-cf5d5cb2-83f6-41c4-9e70-693b6b16ee95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:56:58.263210 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-cf5d5cb2-83f6-41c4-9e70-693b6b16ee95 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086311 Dec 15 18:56:58.269495 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Dec 15 18:56:58 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:57:00.644954 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-106aa5af-57fc-4e02-8322-b9a61a5fa60b admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:00.645995 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-106aa5af-57fc-4e02-8322-b9a61a5fa60b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Dec 15 18:57:00.646401 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:57:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:00.702204 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-483cadfb-94ca-4f73-b641-49d22938546d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:00.793968 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-483cadfb-94ca-4f73-b641-49d22938546d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.140613 Dec 15 18:57:00.794629 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:57:00 2021] POST /compute/v2.1/flavors => generated 406 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:57:00.806554 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-e5f84bd8-33a7-4bd2-8c45-f9aacd816db4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:00.923752 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-e5f84bd8-33a7-4bd2-8c45-f9aacd816db4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120764 Dec 15 18:57:00.924334 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Dec 15 18:57:00 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 18:57:03.440460 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-483cadfb-94ca-4f73-b641-49d22938546d admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:03.441493 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-483cadfb-94ca-4f73-b641-49d22938546d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 15 18:57:03.441894 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:57:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:03.503877 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-5a1c46f8-03a1-4d0b-bbe3-09ed10a54adf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "swap": 0}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:03.573242 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-5a1c46f8-03a1-4d0b-bbe3-09ed10a54adf admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.124385 Dec 15 18:57:03.573721 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:57:03 2021] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:57:03.586318 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-7f4e8789-6857-4fdf-85fe-52883b74ab6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:03.688904 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-7f4e8789-6857-4fdf-85fe-52883b74ab6d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106149 Dec 15 18:57:03.689930 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Dec 15 18:57:03 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:57:06.118172 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-5a1c46f8-03a1-4d0b-bbe3-09ed10a54adf admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:06.119178 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-5a1c46f8-03a1-4d0b-bbe3-09ed10a54adf admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Dec 15 18:57:06.119574 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:57:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:06.181655 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-3c7128d2-ea52-47d7-8fe0-ee278e712f8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:06.262707 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-3c7128d2-ea52-47d7-8fe0-ee278e712f8f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.132654 Dec 15 18:57:06.263547 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Dec 15 18:57:06 2021] POST /compute/v2.1/flavors => generated 408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:57:06.278177 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-37da66e6-0171-460b-ab79-7ef668575903 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:06.395611 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-37da66e6-0171-460b-ab79-7ef668575903 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121072 Dec 15 18:57:06.396103 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Dec 15 18:57:06 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:57:27.632898 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-3c7128d2-ea52-47d7-8fe0-ee278e712f8f admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:27.633952 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-3c7128d2-ea52-47d7-8fe0-ee278e712f8f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Dec 15 18:57:27.634350 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:57:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:27.692389 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-d7f2a177-0912-4f99-bf77-eeb66c2c981a admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:27.710639 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-d7f2a177-0912-4f99-bf77-eeb66c2c981a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069170 Dec 15 18:57:27.711176 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Dec 15 18:57:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 18:57:29.309318 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-3c7128d2-ea52-47d7-8fe0-ee278e712f8f admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:29.310300 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-3c7128d2-ea52-47d7-8fe0-ee278e712f8f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Dec 15 18:57:29.310696 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 18:57:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:29.503844 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-c0391cba-ca21-438b-9712-85702c0d78ac admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:29.509486 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.wsgi [None req-c0391cba-ca21-438b-9712-85702c0d78ac admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 18:57:29.510050 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-c0391cba-ca21-438b-9712-85702c0d78ac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 18:57:29.510831 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-c0391cba-ca21-438b-9712-85702c0d78ac admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058275 Dec 15 18:57:29.511332 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Dec 15 18:57:29 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 18:57:29.520943 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-6ad8c5e0-07d0-465b-bf1b-f8712cefa3cc admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:29.540739 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-6ad8c5e0-07d0-465b-bf1b-f8712cefa3cc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023295 Dec 15 18:57:29.541295 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Dec 15 18:57:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 18:57:29.551580 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-27c036ba-4e8e-47b2-9b39-e0839048ae72 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:29.572463 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-27c036ba-4e8e-47b2-9b39-e0839048ae72 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024306 Dec 15 18:57:29.572982 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Dec 15 18:57:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 18:57:29.582524 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-1a2afdc7-1345-461c-a0a4-dd1551af9c9a admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:29.587772 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.wsgi [None req-1a2afdc7-1345-461c-a0a4-dd1551af9c9a admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 18:57:29.588337 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-1a2afdc7-1345-461c-a0a4-dd1551af9c9a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 18:57:29.589155 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-1a2afdc7-1345-461c-a0a4-dd1551af9c9a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010066 Dec 15 18:57:29.589644 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Dec 15 18:57:29 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 18:57:31.056833 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-27c036ba-4e8e-47b2-9b39-e0839048ae72 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:31.057929 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-27c036ba-4e8e-47b2-9b39-e0839048ae72 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Dec 15 18:57:31.058325 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 18:57:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:31.245326 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-994423dc-c71d-4ed3-9f92-fcb6002321e8 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:31.250939 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.wsgi [None req-994423dc-c71d-4ed3-9f92-fcb6002321e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 18:57:31.251530 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-994423dc-c71d-4ed3-9f92-fcb6002321e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 18:57:31.252315 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-994423dc-c71d-4ed3-9f92-fcb6002321e8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057664 Dec 15 18:57:31.252827 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Dec 15 18:57:31 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 18:57:31.263180 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-2b775115-846f-48bc-b7f8-eb15e7766a0e admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:31.276340 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-2b775115-846f-48bc-b7f8-eb15e7766a0e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017166 Dec 15 18:57:31.276897 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Dec 15 18:57:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 18:57:31.287433 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-efc923f7-c496-4873-a136-575459fa4019 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:31.300883 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-efc923f7-c496-4873-a136-575459fa4019 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016941 Dec 15 18:57:31.301435 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Dec 15 18:57:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 18:57:31.310857 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-b96bd5af-91c9-4176-8b26-6c45b184e6a2 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:31.315851 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.wsgi [None req-b96bd5af-91c9-4176-8b26-6c45b184e6a2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 18:57:31.316411 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-b96bd5af-91c9-4176-8b26-6c45b184e6a2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 18:57:31.317232 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-b96bd5af-91c9-4176-8b26-6c45b184e6a2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009764 Dec 15 18:57:31.317708 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Dec 15 18:57:31 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 18:57:32.781442 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-efc923f7-c496-4873-a136-575459fa4019 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:32.782456 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-efc923f7-c496-4873-a136-575459fa4019 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 15 18:57:32.782837 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 18:57:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:32.972961 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-95b8939b-aead-4383-91e9-7fce0ccb11ab admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:32.978147 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.wsgi [None req-95b8939b-aead-4383-91e9-7fce0ccb11ab admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 18:57:32.978708 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-95b8939b-aead-4383-91e9-7fce0ccb11ab admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 18:57:32.979580 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-95b8939b-aead-4383-91e9-7fce0ccb11ab admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057028 Dec 15 18:57:32.980142 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Dec 15 18:57:32 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 18:57:32.990638 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-9aa71ae2-71a4-4c7c-9ab9-c93bc40e259e admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:33.004066 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-9aa71ae2-71a4-4c7c-9ab9-c93bc40e259e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017184 Dec 15 18:57:33.004577 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Dec 15 18:57:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 18:57:33.015962 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:33.029066 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018077 Dec 15 18:57:33.029603 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Dec 15 18:57:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 18:57:33.038919 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-7aba5206-ae74-41be-a3a1-b3d5ac1a9f0a admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:33.044587 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.wsgi [None req-7aba5206-ae74-41be-a3a1-b3d5ac1a9f0a admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 18:57:33.045157 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-7aba5206-ae74-41be-a3a1-b3d5ac1a9f0a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 18:57:33.045916 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-7aba5206-ae74-41be-a3a1-b3d5ac1a9f0a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010380 Dec 15 18:57:33.046396 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Dec 15 18:57:33 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 18:57:34.522914 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:34.523915 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Dec 15 18:57:34.524338 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 18:57:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:34.713064 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-c0985daf-30c3-41a7-b015-95c441353738 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:34.789162 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-c0985daf-30c3-41a7-b015-95c441353738 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.125525 Dec 15 18:57:34.789631 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Dec 15 18:57:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:57:36.281616 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:36.282410 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Dec 15 18:57:36.282806 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 18:57:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:36.471720 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-2c157af4-b364-4327-a93f-affd1a790dda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:36.540600 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-2c157af4-b364-4327-a93f-affd1a790dda admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.118459 Dec 15 18:57:36.541299 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Dec 15 18:57:36 2021] POST /compute/v2.1/flavors => generated 405 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 18:57:38.009857 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:38.010858 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Dec 15 18:57:38.011254 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 18:57:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:38.204316 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-9b6b6c93-3156-4959-b7e5-d7b1271d000a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:38.284493 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-9b6b6c93-3156-4959-b7e5-d7b1271d000a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.129619 Dec 15 18:57:38.286787 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Dec 15 18:57:38 2021] POST /compute/v2.1/flavors => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 18:57:39.778803 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:39.779789 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Dec 15 18:57:39.780177 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 18:57:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:39.970107 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-2d3306e3-fcab-4590-a23f-084d83d586e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 18:57:40.055118 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-2d3306e3-fcab-4590-a23f-084d83d586e0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.136194 Dec 15 18:57:40.055655 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Dec 15 18:57:39 2021] POST /compute/v2.1/flavors => generated 409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 18:57:41.543325 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:41.544809 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Dec 15 18:57:41.545229 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 18:57:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:57:41.733230 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-834a438e-cdcf-416e-807e-705e7c792fb1 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:57:41.752257 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-834a438e-cdcf-416e-807e-705e7c792fb1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069898 Dec 15 18:57:41.752779 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Dec 15 18:57:41 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 18:58:29.996036 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:58:29.997053 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-301775ac-4777-4790-ba5a-0653c967f684 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Dec 15 18:58:29.997483 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Wed Dec 15 18:58:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 18:58:30.055887 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-31272a75-3d3f-4798-a9d2-951d6d499153 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:58:30.074757 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-31272a75-3d3f-4798-a9d2-951d6d499153 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070959 Dec 15 18:58:30.075279 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Dec 15 18:58:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 18:58:30.098068 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-5a1dd23a-9aa0-4b15-ab07-16eed3d4ebb0 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:58:30.105637 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-5a1dd23a-9aa0-4b15-ab07-16eed3d4ebb0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011195 Dec 15 18:58:30.106149 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Wed Dec 15 18:58:30 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:58:30.118758 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-971829d6-70ee-4ed3-baf9-febbf0ce101b admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:58:30.126157 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-971829d6-70ee-4ed3-baf9-febbf0ce101b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010869 Dec 15 18:58:30.126652 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Wed Dec 15 18:58:30 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 18:58:30.137967 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-e559e77c-18a4-41b3-9700-4c53fa89f2a2 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:58:30.145224 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-e559e77c-18a4-41b3-9700-4c53fa89f2a2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010775 Dec 15 18:58:30.145726 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Wed Dec 15 18:58:30 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 18:58:30.157055 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 18:58:30.164220 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010909 Dec 15 18:58:30.164717 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Wed Dec 15 18:58:30 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:00:09.534440 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-496f4bfc-f68d-46ac-aa15-dab4ceafbd99 tempest-verify_tempest_config-432682340 tempest-verify_tempest_config-432682340-project] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:00:09.536572 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-496f4bfc-f68d-46ac-aa15-dab4ceafbd99 tempest-verify_tempest_config-432682340 tempest-verify_tempest_config-432682340-project] 10.222.0.49 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105956 Dec 15 19:00:09.537132 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 34/69] 10.222.0.49 () {58 vars in 1133 bytes} [Wed Dec 15 19:00:09 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:01:36.507582 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:01:36.508659 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Dec 15 19:01:36.509148 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 36/70] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 19:01:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:01:36.767419 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-b18769d5-f696-4db2-8ef8-22e4f7b25782 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:01:36.769386 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:01:36.769386 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: warnings.warn(msg) Dec 15 19:01:36.770917 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-b18769d5-f696-4db2-8ef8-22e4f7b25782 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:01:36.771360 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-b18769d5-f696-4db2-8ef8-22e4f7b25782 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:01:36.772154 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-b18769d5-f696-4db2-8ef8-22e4f7b25782 admin admin] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:01:36.772579 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-b18769d5-f696-4db2-8ef8-22e4f7b25782 admin admin] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:01:36.804528 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-b18769d5-f696-4db2-8ef8-22e4f7b25782 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152306 Dec 15 19:01:36.805073 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 35/71] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Dec 15 19:01:36 2021] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:01:38.289541 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:01:38.290538 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Dec 15 19:01:38.290932 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 37/72] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 19:01:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:01:38.483260 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-32a762cd-7635-4a63-a7ad-c1719a50761c admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:01:38.484411 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:01:38.484411 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: warnings.warn(msg) Dec 15 19:01:38.485993 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-32a762cd-7635-4a63-a7ad-c1719a50761c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:01:38.486436 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-32a762cd-7635-4a63-a7ad-c1719a50761c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:01:38.487794 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-32a762cd-7635-4a63-a7ad-c1719a50761c admin admin] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:01:38.488228 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-32a762cd-7635-4a63-a7ad-c1719a50761c admin admin] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:01:38.507378 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-32a762cd-7635-4a63-a7ad-c1719a50761c admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075213 Dec 15 19:01:38.507938 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 36/73] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Dec 15 19:01:38 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:01:50.425791 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:01:50.426773 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Dec 15 19:01:50.427152 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 38/74] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 19:01:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:01:50.619665 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-5c270b2a-413c-46f4-8ca7-3dea88435c98 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:01:50.620829 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:01:50.620829 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: warnings.warn(msg) Dec 15 19:01:50.622390 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-5c270b2a-413c-46f4-8ca7-3dea88435c98 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:01:50.622826 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-5c270b2a-413c-46f4-8ca7-3dea88435c98 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:01:50.623609 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-5c270b2a-413c-46f4-8ca7-3dea88435c98 admin admin] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:01:50.624033 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-5c270b2a-413c-46f4-8ca7-3dea88435c98 admin admin] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:01:50.648745 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-5c270b2a-413c-46f4-8ca7-3dea88435c98 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080587 Dec 15 19:01:50.649357 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 37/75] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Dec 15 19:01:50 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:01:52.164942 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: DEBUG nova.api.openstack.wsgi [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] Calling method '>' {{(pid=102299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:01:52.166006 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: INFO nova.api.openstack.requestlog [None req-443a8985-a1fa-4b05-8192-4f7055f1dbc2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 15 19:01:52.166404 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: [pid: 102299|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Dec 15 19:01:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:01:52.357597 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG nova.api.openstack.wsgi [None req-0cf465e2-5e77-4bad-8ac6-4fdcefc18114 admin admin] Calling method '>' {{(pid=102298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:01:52.358747 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:01:52.358747 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: warnings.warn(msg) Dec 15 19:01:52.360273 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-0cf465e2-5e77-4bad-8ac6-4fdcefc18114 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:01:52.360748 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-0cf465e2-5e77-4bad-8ac6-4fdcefc18114 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:01:52.361582 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-0cf465e2-5e77-4bad-8ac6-4fdcefc18114 admin admin] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:01:52.362011 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: DEBUG oslo_concurrency.lockutils [None req-0cf465e2-5e77-4bad-8ac6-4fdcefc18114 admin admin] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:01:52.383094 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: INFO nova.api.openstack.requestlog [None req-0cf465e2-5e77-4bad-8ac6-4fdcefc18114 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076192 Dec 15 19:01:52.383575 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: [pid: 102298|app: 0|req: 38/77] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Dec 15 19:01:52 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:02:48.014856 dv-cinder-812685-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 19:02:48.015728 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: Wed Dec 15 19:02:48 2021 - graceful shutdown triggered... Dec 15 19:02:48.016234 dv-cinder-812685-5-iscsi devstack@n-api.service[102298]: Gracefully killing worker 1 (pid: 102298)... Dec 15 19:02:48.016646 dv-cinder-812685-5-iscsi devstack@n-api.service[102299]: Gracefully killing worker 2 (pid: 102299)... Dec 15 19:02:49.016525 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: worker 1 buried after 1 seconds Dec 15 19:02:49.017036 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: worker 2 buried after 1 seconds Dec 15 19:02:49.017036 dv-cinder-812685-5-iscsi devstack@n-api.service[102297]: goodbye to uWSGI. Dec 15 19:02:49.018628 dv-cinder-812685-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 19:02:49.019192 dv-cinder-812685-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 19:02:49.022009 dv-cinder-812685-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 19:02:49.032202 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 19:02:49 2021] *** Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: nodename: dv-cinder-812685-5-iscsi Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: machine: x86_64 Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: clock source: unix Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: pcre jit disabled Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: detected number of CPU cores: 4 Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: current working directory: / Dec 15 19:02:49.035387 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: detected binary path: /usr/bin/uwsgi-core Dec 15 19:02:49.036037 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: your processes number limit is 47680 Dec 15 19:02:49.036037 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: your memory page size is 4096 bytes Dec 15 19:02:49.036037 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: detected max file descriptor number: 2048 Dec 15 19:02:49.036037 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: lock engine: pthread robust mutexes Dec 15 19:02:49.036037 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: thunder lock: enabled Dec 15 19:02:49.036037 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 19:02:49.036037 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 19:02:49.079943 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: Python main interpreter initialized at 0x5570f85b89c0 Dec 15 19:02:49.079943 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: python threads support enabled Dec 15 19:02:49.079943 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: your server socket listen backlog is limited to 100 connections Dec 15 19:02:49.079943 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: your mercy for graceful operations on workers is 90 seconds Dec 15 19:02:49.080903 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 19:02:49.080903 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: *** Operational MODE: preforking *** Dec 15 19:02:49.081193 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: *** uWSGI is running in multiple interpreter mode *** Dec 15 19:02:49.081193 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: spawned uWSGI master process (pid: 116500) Dec 15 19:02:49.081396 dv-cinder-812685-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 19:02:49.083285 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: spawned uWSGI worker 1 (pid: 116514, cores: 1) Dec 15 19:02:49.083285 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: spawned uWSGI worker 2 (pid: 116515, cores: 1) Dec 15 19:02:49.083285 dv-cinder-812685-5-iscsi devstack@n-api.service[116500]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 19:02:50.979179 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 19:02:50.979179 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: from cryptography.utils import int_from_bytes Dec 15 19:02:50.979861 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 19:02:50.979861 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: from cryptography.utils import int_from_bytes Dec 15 19:02:50.994284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 19:02:50.994284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: from cryptography.utils import int_from_bytes Dec 15 19:02:50.994848 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 19:02:50.994848 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: from cryptography.utils import int_from_bytes Dec 15 19:02:53.399933 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 19:02:53.400453 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 19:02:53.400728 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 19:02:53.400980 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 19:02:53.401287 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 19:02:53.401683 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.402016 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.402346 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.402675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.403020 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.403336 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.403663 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.403993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.404332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.404598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.404921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.405281 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-5-iscsi {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.405614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.405929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.406246 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.406573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.406884 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.407216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.407531 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.408039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.410028 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.410028 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.410028 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.410287 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 19:02:53.410647 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.410730 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 19:02:53.410808 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.410888 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 19:02:53.410968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.410968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.411113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 19:02:53.411201 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 19:02:53.411277 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.411637 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.411900 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.412142 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.412396 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.412396 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.412845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-5-iscsi {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.413128 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.413349 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.413566 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.413781 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.413998 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.414215 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.414431 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.414634 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.414868 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.415082 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.415297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.415509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.415722 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.415942 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.416159 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.416334 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.416552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-5-iscsi {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.416699 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.416882 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.417037 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.417267 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.417424 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.417593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.417744 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.417930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.418087 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.420790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.420975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.421176 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.421341 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.421497 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.421651 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.421813 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.421988 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.422140 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.422283 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.422438 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.422583 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.422583 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.422870 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.423012 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.423160 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.423318 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.423467 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.425250 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.425424 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.425424 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.425718 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.425718 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.426012 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.426167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.426322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.426478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.426636 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.426779 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.426952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-5-iscsi {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.427105 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.427249 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.427410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.427561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.427711 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.427856 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.428005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.428005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.428284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.428429 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.428571 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.428719 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.429211 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.429374 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.429529 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.429672 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.429820 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.429981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.430542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.430711 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.430863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.431014 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.431165 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.431308 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.431457 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.431621 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.431765 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.431924 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.432077 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.432220 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.432368 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.432520 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.432664 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.432806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.432955 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.433139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.433301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.433301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.433598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.433758 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.434178 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.434338 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.434492 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.434662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.435098 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.435258 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.435402 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.435563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.435816 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.435967 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.436122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.436277 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.436422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.436582 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.436736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.436887 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.437036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.437233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.437386 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.437538 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.437680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.437841 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.437992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.438142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.438292 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.438445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.438599 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.438750 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.438902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.439046 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.439198 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.439352 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.439495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.439644 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.439804 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.439948 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.440107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.440249 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.440399 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.440551 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.440699 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.440857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.441051 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.441234 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.441391 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.441535 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.441676 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.441861 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.442565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.442672 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.442749 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.442827 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.442905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.442987 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443057 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443125 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443191 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443259 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443333 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443419 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443498 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443567 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443646 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443790 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443866 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.443935 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444012 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444093 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444164 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444237 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444348 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444428 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444512 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444667 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444735 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444809 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.444964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445034 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445144 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445229 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445442 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445518 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445856 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.445856 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446029 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446116 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446207 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446379 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446621 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446709 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446797 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446877 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.446964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447045 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447124 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447305 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447393 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447487 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447568 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447735 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447735 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447884 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.447978 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.447978 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.448142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.448229 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.448310 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.448398 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.448479 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.448558 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.448645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.448645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.448811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.448811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.448958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.449037 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.449150 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.449150 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.449308 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.449398 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.449486 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.449573 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.449661 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.449742 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.449833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.449923 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.450012 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.450100 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.450182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.450271 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.450363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.450450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.450537 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.450627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.450708 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.450908 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.451092 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.451264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.451422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.451579 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.451723 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.451876 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.452027 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.452178 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.452331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.452483 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.452634 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.452779 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.452922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.453065 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.453273 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.453418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.453622 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.453774 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.453917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.454067 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.454502 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.454662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.454815 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.454975 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.455918 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.456069 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 19:02:53.456242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.456575 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.456738 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.456883 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.457035 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.457257 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.457528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.457690 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.457842 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.457985 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.458179 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.458335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.458493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.458656 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.458800 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.458942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.459084 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.459235 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.459392 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.459536 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.459678 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.459827 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.459979 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.460197 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.460357 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.460508 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.460669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.460822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.460976 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.461162 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.461323 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.461474 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.461624 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.461767 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.461916 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.462139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.462292 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.462436 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.462596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.462740 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.462890 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.463045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.463188 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.463337 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.463481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.463623 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.463773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.463930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.464072 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.464214 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.464638 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.464801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.464955 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.465161 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.465322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.465467 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.466048 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.466214 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.466367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.466530 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.466780 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.466930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.467081 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.467232 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.467401 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.467638 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.467796 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.467940 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.468082 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.468224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.468379 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.468524 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.468667 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.468809 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.468958 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.469149 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.469319 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.469463 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.469613 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.469782 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.470202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.470438 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.470592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.470737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.471520 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.471673 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.471827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.471981 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.472125 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.472360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.472516 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.472668 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.472818 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.472975 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.473139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.473298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.473449 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.473599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.473741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.473914 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.474813 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.474983 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.475145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.475290 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.475447 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.475599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.475742 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.476221 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.476383 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.476528 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.476685 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.476944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.477133 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.477284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.477427 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.477581 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.477831 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.477987 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.478133 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.478275 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.478417 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.478560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.478789 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.478943 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.479086 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.479229 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.479371 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.479521 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.479682 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.479825 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.479975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.480117 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.480268 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.480431 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.480575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.480718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.480859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.481000 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.481165 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.481348 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.481595 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.481745 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.481895 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.482044 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.482194 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.482357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.482506 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.482649 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.482798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.482948 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.483100 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.483243 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.483393 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.483546 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.483697 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.483916 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.484074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.484224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.484375 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.484524 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.484894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.485227 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.496513 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.496723 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.497008 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.497327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.497327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.497666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.497833 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.498082 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.498252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.498405 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.498557 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.498724 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.498876 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.499036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.499189 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.499348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.499508 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.499685 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.499838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.499988 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.500149 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.500309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.500468 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.500636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.500797 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.501039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.501306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.501462 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.501622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.501784 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.501955 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.502148 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.502303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.502454 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.502454 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.502750 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.502909 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.503062 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.503062 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.504081 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.504269 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.504438 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.504598 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.504758 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.505432 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.505612 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.505769 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.505921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.506074 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.506242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.506658 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.506837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.507010 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.507285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.507595 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.507756 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.507917 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.508093 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.508350 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.508555 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.508725 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.508887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.509040 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.509220 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.509384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.509538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.509715 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.509875 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.510028 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.510179 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.510329 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.510495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.510664 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.510824 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.510984 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.511143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.511294 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.511460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.511612 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.512040 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.512202 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.512398 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.512566 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.512734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.512894 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.513055 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.513232 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.513394 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.513546 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.513713 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.513874 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.514033 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.514203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.514355 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.514513 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.514675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.514828 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.515014 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.515335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.515598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.515757 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.516002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.516167 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.516806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.516962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.517122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.517266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.517381 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.517491 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.517608 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.518323 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.518440 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.518559 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.518677 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.518794 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.518907 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.519016 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.519123 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.519244 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.519353 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.519462 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.519585 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.519700 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.519815 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.519932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520050 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520166 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520276 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520368 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520462 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520546 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520888 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.520979 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.521074 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.521281 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.521413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.521511 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.521595 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.521687 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.521778 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.521860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.521942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522029 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522280 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522508 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522615 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522699 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522780 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.522941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523020 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523116 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523209 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523380 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523462 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523818 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523906 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.523988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524069 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524162 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524244 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524325 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524405 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524486 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524855 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.524953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525223 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525453 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525629 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525698 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525774 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525881 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.525965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526126 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526216 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526398 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526567 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526649 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.526986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.527429 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.527518 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.527518 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.527518 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.527742 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.527830 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.527830 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.527996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528084 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528173 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528254 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528525 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528766 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.528941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529023 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529117 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529200 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529289 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529442 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529702 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529776 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529852 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.529981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530194 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530323 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530439 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530549 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530652 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530736 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530823 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.530985 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531072 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531171 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531261 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531390 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531487 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531571 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531651 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531743 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.531915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532101 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532190 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532271 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532358 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532446 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532538 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532710 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532796 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532878 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.532964 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.533150 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.533261 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.533938 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534033 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534126 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534380 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534461 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534714 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534804 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534893 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.534893 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535058 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535148 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535310 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535414 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535486 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535561 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535687 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535903 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.535987 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536076 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536158 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536248 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536339 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536430 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536430 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536675 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536758 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536848 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.536936 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537025 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537178 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537178 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537417 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537684 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537766 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537855 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.537935 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538079 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538154 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538312 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538390 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538459 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538533 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538603 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538677 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538754 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538754 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.538969 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.539037 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.539111 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.539189 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.539330 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.539428 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.539501 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.539568 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.539731 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.539880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.540070 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.540173 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.540362 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.540464 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.541295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.541547 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.541709 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.541874 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.542046 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.542210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.542374 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.542522 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.542679 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.542839 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.542997 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.543154 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.543312 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.543469 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.543625 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.543787 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.543937 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.544097 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.544205 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.544290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.544372 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.544461 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.544552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.544648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.544648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.544928 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.545274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.545564 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.545690 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.545815 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.545903 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.545984 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.546202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.546295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.546525 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.546636 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.546844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.546944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.547168 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.547260 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.547491 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.547593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.547812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.547912 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.548134 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.548234 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.548450 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.548543 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.548764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.548863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.549151 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.549246 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.549475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.549574 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.549789 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.549908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.550106 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.550421 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.550526 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.550649 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.550790 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.551024 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.551134 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.551336 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.551476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.551707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.551822 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.552020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.552150 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.552341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.552472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.552669 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.552794 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.552993 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.553109 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.553430 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.553532 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.553749 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.553857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.554061 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.554168 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.554381 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.554483 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.554691 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.554789 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.555006 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.555118 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.555316 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.555442 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.555628 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.555764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.555988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.556096 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.556267 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.556385 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.556583 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.556698 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.556908 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.557010 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.557258 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.557351 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.557589 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.557681 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.557897 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.558002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.558209 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.558309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.558525 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.558625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.558838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.558992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.559154 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.559253 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.559468 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.559587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.559783 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.559910 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.560119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.560211 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.560448 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.560636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.560885 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.560989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.561229 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.561339 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.561542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.561644 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.561854 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.561959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.562168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.562259 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.562475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.562565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.562801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.562900 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.563112 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.563212 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.563418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.563509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.563729 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.563821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.564035 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.564135 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.564350 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.564451 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.564685 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.564777 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.565022 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.565196 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.565377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.565483 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.565699 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.565840 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.566042 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.566188 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.566374 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.566484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.566690 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.566783 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.567009 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.567100 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.567327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.567428 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.567633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.567725 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.568005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.568097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.568317 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.568419 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.568635 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.568727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.568945 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.569038 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.569277 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.569385 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.569583 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.569683 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.569898 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.569996 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.570217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.570346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.570543 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.570661 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.570863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.570979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.571175 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.571277 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.571488 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.571611 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.571817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.571926 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.572126 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.572224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.572456 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.572649 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.572781 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.572967 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.573147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.573299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.573457 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.573715 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.573817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.574028 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.574120 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.574339 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.574439 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.574662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.574762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.574979 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.575069 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.575290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.575381 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.575596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.575689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.575912 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.576003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.576227 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.576331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.576551 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.576656 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.576873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.576978 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.577213 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.577326 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.577530 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.577635 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.577837 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.577930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.578158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.578260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.578481 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.578573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.578801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.578901 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.579109 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.579213 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.579419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.579581 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.579736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.579864 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.580048 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.580688 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.580948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.581048 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.581212 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.581315 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.581529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.581695 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.581828 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.581926 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.582138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.582239 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.582449 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.582554 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.582764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.582856 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.583073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.583172 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.583381 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.583473 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.583695 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.583794 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.584003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.584095 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.584315 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.584407 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.584622 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.584720 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.584925 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.585025 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.585294 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.585396 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.585599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.585697 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.585922 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.586073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.586238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.586348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.586564 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.586668 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.586882 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.587003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.587193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.587308 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.587518 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.587619 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.587826 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.587942 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.588132 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.588248 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.588435 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.588527 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.588741 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.588841 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.589065 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.589181 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.589403 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.589512 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.589716 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.589808 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.590041 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.590139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.590365 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.590456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.590673 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.590772 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.591055 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.591245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.591339 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.591579 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.591686 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.591899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.591994 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.592217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.592321 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.592532 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.592631 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.592837 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.592936 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.593171 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.593293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.593476 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.593576 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.593780 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.593872 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.594104 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.594251 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.594394 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.594495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.594698 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.594835 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.595000 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.595106 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.595306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.595406 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.595627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.595720 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.596626 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.596744 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.596881 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.596982 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.597227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.597323 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.597538 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.597644 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.597847 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.597940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.598152 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.598252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.598495 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.598597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.598800 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.598893 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.599125 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.599216 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.599442 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.599534 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.599759 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.599851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.600078 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.600170 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.600393 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.600496 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.600711 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.600810 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.601032 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.601191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.601375 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.601469 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.601690 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.601801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.602008 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.602119 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.602325 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.602425 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.602641 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.602739 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.602957 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.603058 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.603268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.603367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.603585 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.603677 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.603901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.604023 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.604219 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.604426 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.604749 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.604840 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.605134 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.605245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.605416 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.605517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.605729 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.605830 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.606042 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.606164 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.606357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.606451 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.606688 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.606836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.606982 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.607077 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.607284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.607386 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.607597 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.607702 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.607908 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.608009 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.608216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.608308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.608544 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.608654 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.608860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.608958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.609195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.609305 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.609525 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.609629 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.609842 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.609935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.610158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.610383 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.610489 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.610744 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.610837 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.611070 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.611208 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.611489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.611595 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.611739 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.611832 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.612057 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.612188 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.612368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.612510 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.612679 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.612771 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.612991 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.613137 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.613328 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.613430 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.613640 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.613740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.613952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.614052 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.614262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.614355 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.614573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.614667 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.614885 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.614977 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.615199 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.615302 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.615512 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.615615 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.615829 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.615936 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.616138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.616238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.616453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.616544 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.616770 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.616914 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.617088 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.617312 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.617413 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.617630 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.617730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.617995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.618111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.618313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.618413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.618627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.618727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.618937 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.619044 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.619254 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.619350 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.619561 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.619672 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.619878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.619975 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.620184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.620288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.620495 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.620608 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.620802 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.620906 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.621138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.621261 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.621455 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.621637 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.621786 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.621888 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.622093 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.622224 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.622401 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.622506 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.622710 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.622812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.623027 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.623240 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.623351 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.623589 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.623695 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.623909 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.624002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.624237 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.624343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.624564 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.624665 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.624882 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.625166 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.625284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.625528 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.625627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.625834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.625934 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.626139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.626233 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.626456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.626549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.626765 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.626909 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.627092 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.627198 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.627398 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.627491 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.627708 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.627812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.628018 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.628124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.628321 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.628415 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.628632 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.628724 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.628937 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.629042 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.629289 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.629404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.629594 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.629689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.629903 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.629996 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.630207 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.630321 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.630519 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.630630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.630823 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.630928 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.631129 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.631240 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.631436 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.631688 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.631791 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.631877 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.632042 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.632136 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.632344 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.632475 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.632657 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.632751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.632963 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.633060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.633300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.633409 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.633605 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.633698 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.634026 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.634166 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.634278 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.634399 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.634524 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.634627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.634828 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.634920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.635132 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.635301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.635449 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.635624 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.635757 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.635952 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.636079 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.636281 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.636395 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.636606 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.636965 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.637224 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.637337 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.637558 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.637658 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.637878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.638158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.638332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.638513 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.638619 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.638849 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.638950 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.639191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.639283 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.639528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.639621 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.639842 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.639933 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.640150 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.640255 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.640458 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.640552 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.640767 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.640860 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.641121 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.641235 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.641419 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.641520 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.641736 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.641847 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.642047 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.642150 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.642359 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.642491 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.643180 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.643292 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.643495 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.643590 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.643807 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.643907 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.644118 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.644217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.644436 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.644538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.644764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.644861 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.645102 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.645211 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.645439 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.645533 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.645754 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.645854 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.646071 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.646173 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.646382 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.646482 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.646694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.646795 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.647008 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.647113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.647316 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.647418 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.647635 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.647735 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.647965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.648066 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.648276 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.648376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.648582 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.648680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.648919 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.649030 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.649273 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.649391 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.649596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.649718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.649916 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.650083 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.650252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.650346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.650571 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.650663 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.650894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.650999 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.651214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.651315 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.651534 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.651636 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.651886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.651993 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.652178 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.652281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.652511 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.652653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.652839 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.652934 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.653190 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.653289 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.653500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.653604 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.653807 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.653900 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.654114 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.654207 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.654428 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.654529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.654760 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.654853 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.655095 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.655196 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.655411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.655544 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.655735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.655830 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.655981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 19:02:53.656073 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.656356 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.656664 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.656985 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.657333 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.657652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.657963 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.658899 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.659223 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.659540 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.659863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.660177 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.660489 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.660800 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.661147 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.661476 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.661783 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.662113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.662429 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.662751 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.663065 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.663378 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.663704 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.664016 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.664333 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.664645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.664958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.665308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.665627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.665951 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.666275 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.666634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.666964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.667341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.667621 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.667966 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.668293 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.668608 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.668923 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.669252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 19:02:53.669496 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 19:02:53.679101 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_db.sqlalchemy.engines [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 19:02:53.691480 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_db.sqlalchemy.engines [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 19:02:53.745848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.context [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),415a2223-155c-4f3b-b9fc-3b76c07aa9ed(cell1) {{(pid=116514) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 19:02:53.750130 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:02:53.751730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:02:53.752593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:02:53.754580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:02:53.756857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.context [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),415a2223-155c-4f3b-b9fc-3b76c07aa9ed(cell1) {{(pid=116515) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 19:02:53.761334 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:02:53.763274 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:02:53.764109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:02:53.766146 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:02:53.767161 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_db.sqlalchemy.engines [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 19:02:53.768964 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_db.sqlalchemy.engines [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 19:02:53.779372 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_db.sqlalchemy.engines [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 19:02:53.780260 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_db.sqlalchemy.engines [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 19:02:53.932132 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_db.sqlalchemy.engines [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 19:02:53.938888 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_db.sqlalchemy.engines [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 19:02:54.262657 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: WARNING keystonemiddleware.auth_token [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 19:02:54.263504 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: WARNING keystonemiddleware.auth_token [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 19:02:54.269322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: WARNING keystonemiddleware.auth_token [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 19:02:54.270147 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: WARNING keystonemiddleware.auth_token [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 19:02:54.612242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: WARNING keystonemiddleware.auth_token [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 19:02:54.615535 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: WARNING keystonemiddleware.auth_token [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 19:02:54.617453 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: WARNING keystonemiddleware.auth_token [None req-660c291c-808b-4abe-8f14-54b7a2f1d6cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 19:02:54.621251 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: WARNING keystonemiddleware.auth_token [None req-76db9600-d5da-498c-91fd-0eaae2f1f8b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 19:02:54.622924 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5570f85b89c0 pid: 116514 (default app) Dec 15 19:02:54.626578 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5570f85b89c0 pid: 116515 (default app) Dec 15 19:03:29.686404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1cde7033-01be-417a-af1e-0600947e46f5 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] Action: 'create', calling method: .version_select at 0x7f80b78c9e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-405506763", "metadata": {"Type": "work"}}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:30.195682 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1953dcf9-235c-4e22-b96f-319ab0da4793 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Action: 'create', calling method: .version_select at 0x7f80b78c9e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-14210013"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:31.763810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1cde7033-01be-417a-af1e-0600947e46f5 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.167308 Dec 15 19:03:31.765444 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Dec 15 19:03:28 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3171 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 19:03:31.856493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-86931880", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "networks": [{"uuid": "3eef4975-1e4b-4548-9e9f-50d40af67cbd"}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:31.993917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] validate_networks() for [('3eef4975-1e4b-4548-9e9f-50d40af67cbd', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:03:32.315680 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1953dcf9-235c-4e22-b96f-319ab0da4793 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.055131 Dec 15 19:03:32.319124 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 1/2] 10.222.0.49 () {60 vars in 1154 bytes} [Wed Dec 15 19:03:29 2021] POST /compute/v2.1/os-volumes => generated 343 bytes in 3058 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 19:03:32.396717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1152963875", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "networks": [{"uuid": "9b5341ac-959a-4f9c-b267-56c4cfd3994a"}]}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:32.654885 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.network.neutron [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] validate_networks() for [('9b5341ac-959a-4f9c-b267-56c4cfd3994a', None, None, None, None, None)] {{(pid=116515) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:03:33.513969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:03:33.515081 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:03:33.515778 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:03:33.516948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:03:33.517731 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:03:33.535251 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:33.536507 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:33.537646 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:33.538156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:33.573027 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Getting quotas for project d219be39d8e34b20aaff02dceb7ea34d. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:03:33.581591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Getting quotas for user 31395cc63a4d4901bf539ca266541c3c and project d219be39d8e34b20aaff02dceb7ea34d. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:03:33.598700 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:03:33.601655 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:03:33.729925 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Flavor limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:03:33.729925 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Image limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:03:33.729925 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Flavor pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:03:33.729925 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Image pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:03:33.731593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:03:33.751773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:33.752560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:33.753635 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:33.754300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:33.787842 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Getting quotas for project 52e4764fb4d34d5dbdd967080b99c537. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:03:33.795217 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Getting quotas for user d79566c6c23e4944aadc60c1957cff95 and project 52e4764fb4d34d5dbdd967080b99c537. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:03:33.808932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Going to run 1 instances... {{(pid=116515) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:03:33.812302 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:03:33.850697 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1344e9dd-c8d8-4992-9c3d-5f00f6476028 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.082469 Dec 15 19:03:33.853757 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:03:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:03:33.880041 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3a948d3e-5c7f-4e2b-a1a1-84c029446eb2 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] Calling method '.version_select at 0x7f80b76b0700>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:34.053993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3a948d3e-5c7f-4e2b-a1a1-84c029446eb2 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4" status: 200 len: 353 microversion: 2.1 time: 0.198517 Dec 15 19:03:34.056227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:33 2021] GET /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4 => generated 353 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:34.067196 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1e089eb5-9b16-4bc8-9aa7-dfc23d8fde25 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6e4a310>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:34.160956 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5025e246-be17-4f90-94e4-97be8b9a975e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.842824 Dec 15 19:03:34.162261 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 2/5] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:03:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:03:34.180399 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f0e1015b-368c-49f1-a7a5-2be69a144696 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:34.183757 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f0e1015b-368c-49f1-a7a5-2be69a144696 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:34.224065 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1e089eb5-9b16-4bc8-9aa7-dfc23d8fde25 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7" status: 200 len: 344 microversion: 2.1 time: 0.165939 Dec 15 19:03:34.225735 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 4/6] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:34 2021] GET /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:34.231332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ff29e59d-eef1-462b-8a33-d4807ba8cad2 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] Calling method '.version_select at 0x7f80b76b0f70>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:34.443606 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f0e1015b-368c-49f1-a7a5-2be69a144696 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:34.452654 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ff29e59d-eef1-462b-8a33-d4807ba8cad2 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4" status: 200 len: 353 microversion: 2.1 time: 0.226897 Dec 15 19:03:34.453323 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 5/7] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:34 2021] GET /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4 => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:34.461547 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f0b4e839-21df-416b-804f-2a430c352510 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:34.462387 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f0b4e839-21df-416b-804f-2a430c352510 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:34.488346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f0e1015b-368c-49f1-a7a5-2be69a144696 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1213 microversion: 2.1 time: 0.324578 Dec 15 19:03:34.489964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 3/8] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:34 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1213 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:34.513475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-80548403-93cd-4bc2-9b10-1431ae49dbac tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Action: 'create', calling method: .version_select at 0x7f80b6e48af0>, body: {"snapshot": {"volume_id": "8ee74f64-ed83-4def-974d-57c8d2b5c6a7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1658682345"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:34.772585 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f0b4e839-21df-416b-804f-2a430c352510 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:34.814461 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f0b4e839-21df-416b-804f-2a430c352510 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1218 microversion: 2.1 time: 0.358091 Dec 15 19:03:34.818762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 6/9] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:34 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1218 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:34.848843 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1ecad9f4-7e12-4c2d-900c-b9cc33c712a8 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] Calling method '.version_select at 0x7f80b6e4a0d0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:35.238678 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1ecad9f4-7e12-4c2d-900c-b9cc33c712a8 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4" status: 202 len: 0 microversion: 2.1 time: 0.418581 Dec 15 19:03:35.239358 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 7/10] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Dec 15 19:03:34 2021] DELETE /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:03:35.264199 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b744317f-17f7-4634-aa9b-c3d6c4ae86a5 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] Calling method '.version_select at 0x7f80b6e4a1f0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:35.316006 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-80548403-93cd-4bc2-9b10-1431ae49dbac tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.823159 Dec 15 19:03:35.317642 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 4/11] 10.222.0.49 () {60 vars in 1161 bytes} [Wed Dec 15 19:03:34 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:35.332573 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-51b2acaa-860b-4bf2-bc2d-2fc68543cfb7 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6e48b80>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:35.343314 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b744317f-17f7-4634-aa9b-c3d6c4ae86a5 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4" status: 200 len: 352 microversion: 2.1 time: 0.099596 Dec 15 19:03:35.345699 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 8/12] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:35 2021] GET /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:03:35.367576 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-51b2acaa-860b-4bf2-bc2d-2fc68543cfb7 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 200 len: 287 microversion: 2.1 time: 0.044009 Dec 15 19:03:35.368898 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 5/13] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Dec 15 19:03:35 2021] GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:03:35.378822 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9ceffa79-febd-49c0-a737-bf2b1fa3851d tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6e67e50>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:35.446068 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9ceffa79-febd-49c0-a737-bf2b1fa3851d tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.071525 Dec 15 19:03:35.446653 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 9/14] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Dec 15 19:03:35 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:35.458485 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3e445f48-c1b3-4195-aa63-1f98859a3685 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6e63790>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:35.491782 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3e445f48-c1b3-4195-aa63-1f98859a3685 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 200 len: 287 microversion: 2.1 time: 0.038217 Dec 15 19:03:35.493667 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 6/15] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Dec 15 19:03:35 2021] GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:35.514780 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b56a17cd-7bd8-4121-8503-97aa491c2d9c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:35.515740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b56a17cd-7bd8-4121-8503-97aa491c2d9c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:35.633138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b56a17cd-7bd8-4121-8503-97aa491c2d9c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:35.678202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b56a17cd-7bd8-4121-8503-97aa491c2d9c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1213 microversion: 2.1 time: 0.168857 Dec 15 19:03:35.683971 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 10/16] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:35 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:35.832700 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-cb0adbca-069a-4647-a51a-d0e1e9cda649 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:35.833858 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-cb0adbca-069a-4647-a51a-d0e1e9cda649 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:36.025483 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cb0adbca-069a-4647-a51a-d0e1e9cda649 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:36.057937 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-cb0adbca-069a-4647-a51a-d0e1e9cda649 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1218 microversion: 2.1 time: 0.229453 Dec 15 19:03:36.061896 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 7/17] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:35 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1218 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:36.363262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-59f5740e-ad65-4968-8c39-88779b491ea4 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] Calling method '.version_select at 0x7f80b6e723a0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:36.412538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-59f5740e-ad65-4968-8c39-88779b491ea4 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] HTTP exception thrown: Volume e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4 could not be found. Dec 15 19:03:36.413719 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-59f5740e-ad65-4968-8c39-88779b491ea4 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] Returning 404 to user: Volume e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:03:36.415384 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-59f5740e-ad65-4968-8c39-88779b491ea4 tempest-VolumesGetTestJSON-21461193 tempest-VolumesGetTestJSON-21461193-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4" status: 404 len: 109 microversion: 2.1 time: 0.059921 Dec 15 19:03:36.416325 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 11/18] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:36 2021] GET /compute/v2.1/os-volumes/e8fb4f20-a9c2-4d3b-a3a8-8b8950ce63c4 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:03:36.509921 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b10dc5a1-6c4f-4def-8b89-75116a58f2ed tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6e63af0>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:36.648107 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b10dc5a1-6c4f-4def-8b89-75116a58f2ed tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 200 len: 287 microversion: 2.1 time: 0.148144 Dec 15 19:03:36.649466 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 8/19] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Dec 15 19:03:36 2021] GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:36.700092 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0b89b289-86a9-4a9a-9cc6-90063a97bc41 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:36.701249 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0b89b289-86a9-4a9a-9cc6-90063a97bc41 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:36.849265 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0b89b289-86a9-4a9a-9cc6-90063a97bc41 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:36.858234 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0b89b289-86a9-4a9a-9cc6-90063a97bc41 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1213 microversion: 2.1 time: 0.166069 Dec 15 19:03:36.860868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 12/20] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:36 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:37.088303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3b5a2865-4073-4c0d-bfa6-8ee8c7d77eb2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:37.094310 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3b5a2865-4073-4c0d-bfa6-8ee8c7d77eb2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:37.105740 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3b5a2865-4073-4c0d-bfa6-8ee8c7d77eb2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:37.106200 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3b5a2865-4073-4c0d-bfa6-8ee8c7d77eb2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:37.108435 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3b5a2865-4073-4c0d-bfa6-8ee8c7d77eb2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:37.108890 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3b5a2865-4073-4c0d-bfa6-8ee8c7d77eb2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:37.384607 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3b5a2865-4073-4c0d-bfa6-8ee8c7d77eb2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:37.412798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3b5a2865-4073-4c0d-bfa6-8ee8c7d77eb2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1222 microversion: 2.1 time: 0.337846 Dec 15 19:03:37.413528 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 9/21] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:37 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:37.668893 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-23ace93e-b097-4130-a78a-78cff942fd50 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6e72430>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:37.712926 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-23ace93e-b097-4130-a78a-78cff942fd50 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 200 len: 287 microversion: 2.1 time: 0.055865 Dec 15 19:03:37.713663 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 13/22] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Dec 15 19:03:37 2021] GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:37.876739 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a7f47746-0b61-45e3-91a0-3ff72c0736ac tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:37.877539 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a7f47746-0b61-45e3-91a0-3ff72c0736ac tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:37.891068 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7f47746-0b61-45e3-91a0-3ff72c0736ac tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:37.892050 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7f47746-0b61-45e3-91a0-3ff72c0736ac tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:37.895593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7f47746-0b61-45e3-91a0-3ff72c0736ac tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:37.897592 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7f47746-0b61-45e3-91a0-3ff72c0736ac tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:38.222804 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a7f47746-0b61-45e3-91a0-3ff72c0736ac tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:38.233272 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a7f47746-0b61-45e3-91a0-3ff72c0736ac tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1217 microversion: 2.1 time: 0.361270 Dec 15 19:03:38.234281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 10/23] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:37 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1217 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:38.627696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7180a903-13c9-4d7f-9ac3-4e0f4db5d46d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:38.627696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7180a903-13c9-4d7f-9ac3-4e0f4db5d46d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:38.627696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7180a903-13c9-4d7f-9ac3-4e0f4db5d46d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:38.627696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7180a903-13c9-4d7f-9ac3-4e0f4db5d46d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:38.629742 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7180a903-13c9-4d7f-9ac3-4e0f4db5d46d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:38.629742 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7180a903-13c9-4d7f-9ac3-4e0f4db5d46d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:38.658938 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7180a903-13c9-4d7f-9ac3-4e0f4db5d46d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:38.683887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7180a903-13c9-4d7f-9ac3-4e0f4db5d46d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1222 microversion: 2.1 time: 0.257004 Dec 15 19:03:38.684523 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 14/24] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:38 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1222 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:38.747386 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e3903193-f71a-42c2-afe8-067145a95304 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b65810d0>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:38.821609 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e3903193-f71a-42c2-afe8-067145a95304 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 200 len: 287 microversion: 2.1 time: 0.082982 Dec 15 19:03:38.822364 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 11/25] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Dec 15 19:03:38 2021] GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:03:39.250961 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-efe619cf-a392-467e-848c-75d85abf89a4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:39.251629 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-efe619cf-a392-467e-848c-75d85abf89a4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:39.277892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-efe619cf-a392-467e-848c-75d85abf89a4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:39.278725 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-efe619cf-a392-467e-848c-75d85abf89a4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:39.279730 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-efe619cf-a392-467e-848c-75d85abf89a4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:39.282922 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-efe619cf-a392-467e-848c-75d85abf89a4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:39.435098 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-efe619cf-a392-467e-848c-75d85abf89a4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:39.442958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-efe619cf-a392-467e-848c-75d85abf89a4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1217 microversion: 2.1 time: 0.195883 Dec 15 19:03:39.445731 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 12/26] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:39 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:39.507315 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1832671113", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad27c95c-4200-4f8c-a87e-cb2c17144865"}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:39.594240 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] validate_networks() for [('ad27c95c-4200-4f8c-a87e-cb2c17144865', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:03:39.700645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2f458449-2c42-49bd-819b-fdd58e9fca1a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:39.701285 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2f458449-2c42-49bd-819b-fdd58e9fca1a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:39.712300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2f458449-2c42-49bd-819b-fdd58e9fca1a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:39.712790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2f458449-2c42-49bd-819b-fdd58e9fca1a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:39.714265 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2f458449-2c42-49bd-819b-fdd58e9fca1a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:39.714716 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2f458449-2c42-49bd-819b-fdd58e9fca1a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:39.821884 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-2f458449-2c42-49bd-819b-fdd58e9fca1a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:39.831964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2f458449-2c42-49bd-819b-fdd58e9fca1a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1214 microversion: 2.1 time: 0.135178 Dec 15 19:03:39.843462 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 13/27] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:39 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:40.114687 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c1d9d81a-97e9-438d-94d5-fd2b4f6cf267 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'create', calling method: .version_select at 0x7f80b65af040>, body: {"keypair": {"name": "tempest-keypair-7832612"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:40.138758 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-c1d9d81a-97e9-438d-94d5-fd2b4f6cf267 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:03:40.151978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-c1d9d81a-97e9-438d-94d5-fd2b4f6cf267 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for user 497f05dbb53e48a38abf9529018d1766 and project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:03:40.232103 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:03:40.232674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:03:40.233169 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:03:40.233854 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:03:40.234695 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:03:40.265601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:40.266088 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:40.266924 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:40.267377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:40.328958 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Getting quotas for project cadce2bfd827471ca4a8a1591d053c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:03:40.339807 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Getting quotas for user d1f423d3aad94b10b1d3b44d57fa6891 and project cadce2bfd827471ca4a8a1591d053c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:03:40.375227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:03:40.375227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:03:40.465645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-c1d9d81a-97e9-438d-94d5-fd2b4f6cf267 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:03:40.469995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-c1d9d81a-97e9-438d-94d5-fd2b4f6cf267 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for user 497f05dbb53e48a38abf9529018d1766 and project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:03:40.482976 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c1d9d81a-97e9-438d-94d5-fd2b4f6cf267 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 2317 microversion: 2.20 time: 0.637978 Dec 15 19:03:40.488326 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 14/28] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Dec 15 19:03:39 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 639 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 19:03:40.492312 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-95075370-1b2a-495c-b0dd-f6560a3015a8 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6e70280>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:40.498071 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-dbd223da-29ac-4d2c-b32e-0b5178cc186f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.497365 Dec 15 19:03:40.499072 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 15/29] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:03:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:03:40.504311 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1c403e42-65b8-4b3a-bb9d-29391c6563f8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:40.504933 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1c403e42-65b8-4b3a-bb9d-29391c6563f8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:40.519625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1c403e42-65b8-4b3a-bb9d-29391c6563f8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:40.520382 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1c403e42-65b8-4b3a-bb9d-29391c6563f8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:40.521432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1c403e42-65b8-4b3a-bb9d-29391c6563f8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:40.531051 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-95075370-1b2a-495c-b0dd-f6560a3015a8 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 200 len: 288 microversion: 2.1 time: 0.046095 Dec 15 19:03:40.531746 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 15/30] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Dec 15 19:03:40 2021] GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:40.532785 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1c403e42-65b8-4b3a-bb9d-29391c6563f8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:40.549301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f9cc794f-2706-46db-b62f-a00cd5e99fcd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:40.550014 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f9cc794f-2706-46db-b62f-a00cd5e99fcd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:40.628037 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f9cc794f-2706-46db-b62f-a00cd5e99fcd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:40.666269 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f9cc794f-2706-46db-b62f-a00cd5e99fcd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1222 microversion: 2.1 time: 0.124503 Dec 15 19:03:40.677252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 16/31] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:40 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:40.687945 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7ff95f08-2498-41f5-8ef8-3fce8da7ce51 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b65eb160>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:40.713876 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1c403e42-65b8-4b3a-bb9d-29391c6563f8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:40.726670 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1c403e42-65b8-4b3a-bb9d-29391c6563f8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1209 microversion: 2.1 time: 0.226309 Dec 15 19:03:40.728667 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 16/32] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:40 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1209 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:40.852566 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2f0b93e4-96ae-40af-a965-06b049242a6e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:40.852566 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2f0b93e4-96ae-40af-a965-06b049242a6e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:40.859625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2f0b93e4-96ae-40af-a965-06b049242a6e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:40.863507 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2f0b93e4-96ae-40af-a965-06b049242a6e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:40.866071 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2f0b93e4-96ae-40af-a965-06b049242a6e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:40.866544 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2f0b93e4-96ae-40af-a965-06b049242a6e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:40.890327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7ff95f08-2498-41f5-8ef8-3fce8da7ce51 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 202 len: 0 microversion: 2.1 time: 0.211348 Dec 15 19:03:40.895023 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 17/33] 10.222.0.49 () {58 vars in 1253 bytes} [Wed Dec 15 19:03:40 2021] DELETE /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:03:40.902242 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1011714378", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad27c95c-4200-4f8c-a87e-cb2c17144865"}]}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:40.979478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.network.neutron [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] validate_networks() for [('ad27c95c-4200-4f8c-a87e-cb2c17144865', None, None, None, None, None)] {{(pid=116515) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:03:41.027496 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2f0b93e4-96ae-40af-a965-06b049242a6e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:41.050967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2f0b93e4-96ae-40af-a965-06b049242a6e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1214 microversion: 2.1 time: 0.188743 Dec 15 19:03:41.050967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 17/34] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:40 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:03:41.060711 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-389fefb5-52e4-4508-860f-e26453168339 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b65a3ee0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:41.129440 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-389fefb5-52e4-4508-860f-e26453168339 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 200 len: 287 microversion: 2.1 time: 0.087455 Dec 15 19:03:41.130535 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 18/35] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Dec 15 19:03:41 2021] GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:41.653179 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Flavor limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:03:41.662723 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Image limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:03:41.662723 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Flavor pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:03:41.662723 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Image pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:03:41.662723 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:03:41.673263 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:41.674298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:41.677289 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:41.678329 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:41.706869 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Getting quotas for project cadce2bfd827471ca4a8a1591d053c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:03:41.714793 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Getting quotas for user d1f423d3aad94b10b1d3b44d57fa6891 and project cadce2bfd827471ca4a8a1591d053c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:03:41.742036 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Going to run 1 instances... {{(pid=116515) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:03:41.745794 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fb61db5c-e6a2-4466-9b9f-f07df84fb53e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:41.746277 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:03:41.746416 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fb61db5c-e6a2-4466-9b9f-f07df84fb53e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:41.756528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb61db5c-e6a2-4466-9b9f-f07df84fb53e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:41.758344 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb61db5c-e6a2-4466-9b9f-f07df84fb53e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:41.763526 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb61db5c-e6a2-4466-9b9f-f07df84fb53e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:41.764200 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb61db5c-e6a2-4466-9b9f-f07df84fb53e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:41.932013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-dc40dba5-ff5c-454b-bde3-af1b71874584 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.035505 Dec 15 19:03:41.938532 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 18/36] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:03:40 2021] POST /compute/v2.1/servers => generated 383 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:03:41.953478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-01c869e5-914c-4ab6-810b-3fea991b9c88 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:41.954101 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-01c869e5-914c-4ab6-810b-3fea991b9c88 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:42.040193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-01c869e5-914c-4ab6-810b-3fea991b9c88 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:42.051410 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-01c869e5-914c-4ab6-810b-3fea991b9c88 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1222 microversion: 2.1 time: 0.107210 Dec 15 19:03:42.051410 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 19/37] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:41 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:42.069565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6d4a133c-46cf-4a33-9547-afe07788e89c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:42.070099 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6d4a133c-46cf-4a33-9547-afe07788e89c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:42.077494 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6d4a133c-46cf-4a33-9547-afe07788e89c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:42.080219 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6d4a133c-46cf-4a33-9547-afe07788e89c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:42.086797 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6d4a133c-46cf-4a33-9547-afe07788e89c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:42.087272 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6d4a133c-46cf-4a33-9547-afe07788e89c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:42.125723 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fb61db5c-e6a2-4466-9b9f-f07df84fb53e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:42.133732 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fb61db5c-e6a2-4466-9b9f-f07df84fb53e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1209 microversion: 2.1 time: 0.391777 Dec 15 19:03:42.139821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 19/38] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:41 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1209 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:03:42.151916 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-cfe03ae5-cdeb-4ff2-8c96-374b705edd75 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6593430>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:42.197739 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-cfe03ae5-cdeb-4ff2-8c96-374b705edd75 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 200 len: 287 microversion: 2.1 time: 0.051615 Dec 15 19:03:42.198463 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 20/39] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Dec 15 19:03:42 2021] GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:03:42.208024 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6d4a133c-46cf-4a33-9547-afe07788e89c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:42.213307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6d4a133c-46cf-4a33-9547-afe07788e89c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1214 microversion: 2.1 time: 0.147244 Dec 15 19:03:42.225376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 20/40] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:42 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:43.065111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fed79af3-77a6-4356-b9de-3b44e5c86a62 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:43.066578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fed79af3-77a6-4356-b9de-3b44e5c86a62 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:43.155371 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7e030fa9-c124-4d9d-b98f-bc729357a916 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:43.164074 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7e030fa9-c124-4d9d-b98f-bc729357a916 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:43.166617 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7e030fa9-c124-4d9d-b98f-bc729357a916 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:43.167102 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7e030fa9-c124-4d9d-b98f-bc729357a916 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:43.167928 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7e030fa9-c124-4d9d-b98f-bc729357a916 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:43.169611 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7e030fa9-c124-4d9d-b98f-bc729357a916 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:43.231893 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fed79af3-77a6-4356-b9de-3b44e5c86a62 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:43.262583 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fed79af3-77a6-4356-b9de-3b44e5c86a62 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1222 microversion: 2.1 time: 0.198056 Dec 15 19:03:43.264419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 21/41] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:43 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:43.284653 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7ab6080f-1e50-4fc6-ae8c-9b18b22db120 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b65741f0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:43.326522 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7e030fa9-c124-4d9d-b98f-bc729357a916 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:43.341229 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7e030fa9-c124-4d9d-b98f-bc729357a916 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1209 microversion: 2.1 time: 0.194589 Dec 15 19:03:43.341821 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 21/42] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:43 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1209 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:43.354331 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a533996e-fe06-45a5-bd32-238f5443f498 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:43.355046 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a533996e-fe06-45a5-bd32-238f5443f498 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:43.377896 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a533996e-fe06-45a5-bd32-238f5443f498 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:43.378359 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a533996e-fe06-45a5-bd32-238f5443f498 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:43.379174 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a533996e-fe06-45a5-bd32-238f5443f498 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:43.379632 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a533996e-fe06-45a5-bd32-238f5443f498 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:43.406967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-7ab6080f-1e50-4fc6-ae8c-9b18b22db120 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] HTTP exception thrown: Snapshot 13caeff2-cf91-4e24-ab5e-ea880ee92797 could not be found. Dec 15 19:03:43.408145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7ab6080f-1e50-4fc6-ae8c-9b18b22db120 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Returning 404 to user: Snapshot 13caeff2-cf91-4e24-ab5e-ea880ee92797 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:03:43.409938 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7ab6080f-1e50-4fc6-ae8c-9b18b22db120 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797" status: 404 len: 111 microversion: 2.1 time: 0.143982 Dec 15 19:03:43.411490 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 22/43] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Dec 15 19:03:43 2021] GET /compute/v2.1/os-snapshots/13caeff2-cf91-4e24-ab5e-ea880ee92797 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:03:43.420660 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-87d925ed-99cb-43f0-ac86-016ced6661a8 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b65a3820>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:43.514973 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a533996e-fe06-45a5-bd32-238f5443f498 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:43.527600 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a533996e-fe06-45a5-bd32-238f5443f498 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1214 microversion: 2.1 time: 0.184476 Dec 15 19:03:43.532598 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 22/44] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:43 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:43.752706 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-87d925ed-99cb-43f0-ac86-016ced6661a8 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7" status: 202 len: 0 microversion: 2.1 time: 0.337012 Dec 15 19:03:43.753592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 23/45] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Dec 15 19:03:43 2021] DELETE /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:03:43.761534 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2a043849-6c58-4916-b0de-62030afbe9a8 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b659e550>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:44.033234 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2a043849-6c58-4916-b0de-62030afbe9a8 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7" status: 200 len: 343 microversion: 2.1 time: 0.275366 Dec 15 19:03:44.035140 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 23/46] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:43 2021] GET /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7 => generated 343 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:44.279963 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-cf4c35f8-3639-4c23-a490-abecf9160870 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:44.280720 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-cf4c35f8-3639-4c23-a490-abecf9160870 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:44.319108 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf4c35f8-3639-4c23-a490-abecf9160870 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:44.321805 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf4c35f8-3639-4c23-a490-abecf9160870 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:44.321805 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf4c35f8-3639-4c23-a490-abecf9160870 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:44.321805 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf4c35f8-3639-4c23-a490-abecf9160870 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:44.360421 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-896005a3-93a4-43d5-ba50-ec3d03a1e6dc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:44.361301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-896005a3-93a4-43d5-ba50-ec3d03a1e6dc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:44.373068 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-896005a3-93a4-43d5-ba50-ec3d03a1e6dc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:44.374697 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-896005a3-93a4-43d5-ba50-ec3d03a1e6dc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:44.381634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-896005a3-93a4-43d5-ba50-ec3d03a1e6dc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:44.384868 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-896005a3-93a4-43d5-ba50-ec3d03a1e6dc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:44.477240 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-896005a3-93a4-43d5-ba50-ec3d03a1e6dc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:44.481305 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-cf4c35f8-3639-4c23-a490-abecf9160870 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:44.497467 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-896005a3-93a4-43d5-ba50-ec3d03a1e6dc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1273 microversion: 2.1 time: 0.143238 Dec 15 19:03:44.499052 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-cf4c35f8-3639-4c23-a490-abecf9160870 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1218 microversion: 2.1 time: 0.219313 Dec 15 19:03:44.501292 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 24/47] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:44 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:03:44.510771 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:44 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1218 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:44.553941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7869d0e1-332a-41ac-b74f-2cd2dbd8843a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:44.555870 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7869d0e1-332a-41ac-b74f-2cd2dbd8843a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:44.567515 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7869d0e1-332a-41ac-b74f-2cd2dbd8843a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:44.567982 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7869d0e1-332a-41ac-b74f-2cd2dbd8843a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:44.569393 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7869d0e1-332a-41ac-b74f-2cd2dbd8843a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:44.569842 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7869d0e1-332a-41ac-b74f-2cd2dbd8843a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:44.666109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7869d0e1-332a-41ac-b74f-2cd2dbd8843a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:44.674439 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7869d0e1-332a-41ac-b74f-2cd2dbd8843a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1270 microversion: 2.1 time: 0.130781 Dec 15 19:03:44.675557 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 25/49] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:44 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:44.895674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-665114078", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcfdb591-816a-44d0-9526-48dd9abde6af"}], "security_groups": [{"name": "tempest-securitygroup--231870957"}], "key_name": "tempest-keypair-7832612", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:45.046608 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c2a7863f-9b0a-4fc4-b5c9-c556f88424ed tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6567e50>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:45.121793 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-c2a7863f-9b0a-4fc4-b5c9-c556f88424ed tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] HTTP exception thrown: Volume 8ee74f64-ed83-4def-974d-57c8d2b5c6a7 could not be found. Dec 15 19:03:45.122467 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c2a7863f-9b0a-4fc4-b5c9-c556f88424ed tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Returning 404 to user: Volume 8ee74f64-ed83-4def-974d-57c8d2b5c6a7 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:03:45.131091 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c2a7863f-9b0a-4fc4-b5c9-c556f88424ed tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7" status: 404 len: 109 microversion: 2.1 time: 0.081257 Dec 15 19:03:45.131091 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 26/50] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:45 2021] GET /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 19:03:45.138775 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6bab87e4-26c1-45ac-abba-df2a3b2f41dd tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b65af040>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:45.176225 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] validate_networks() for [('fcfdb591-816a-44d0-9526-48dd9abde6af', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:03:45.203143 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-6bab87e4-26c1-45ac-abba-df2a3b2f41dd tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] HTTP exception thrown: Volume 8ee74f64-ed83-4def-974d-57c8d2b5c6a7 could not be found. Dec 15 19:03:45.204633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6bab87e4-26c1-45ac-abba-df2a3b2f41dd tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Returning 404 to user: Volume 8ee74f64-ed83-4def-974d-57c8d2b5c6a7 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:03:45.206146 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6bab87e4-26c1-45ac-abba-df2a3b2f41dd tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7" status: 404 len: 109 microversion: 2.1 time: 0.074570 Dec 15 19:03:45.207888 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 27/51] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Dec 15 19:03:45 2021] DELETE /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 19:03:45.217882 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-af776c4e-03f8-436f-b36f-992e5c924c66 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Calling method '.version_select at 0x7f80b6567430>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:45.270241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-af776c4e-03f8-436f-b36f-992e5c924c66 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] HTTP exception thrown: Volume 8ee74f64-ed83-4def-974d-57c8d2b5c6a7 could not be found. Dec 15 19:03:45.271181 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-af776c4e-03f8-436f-b36f-992e5c924c66 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] Returning 404 to user: Volume 8ee74f64-ed83-4def-974d-57c8d2b5c6a7 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:03:45.272088 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-af776c4e-03f8-436f-b36f-992e5c924c66 tempest-VolumesSnapshotsTestJSON-6344581 tempest-VolumesSnapshotsTestJSON-6344581-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7" status: 404 len: 109 microversion: 2.1 time: 0.060446 Dec 15 19:03:45.272865 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 28/52] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:45 2021] GET /compute/v2.1/os-volumes/8ee74f64-ed83-4def-974d-57c8d2b5c6a7 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:03:45.524087 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f1528aec-1fd5-4a85-a1c5-30e088ee8429 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:45.525390 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f1528aec-1fd5-4a85-a1c5-30e088ee8429 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:45.546378 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f1528aec-1fd5-4a85-a1c5-30e088ee8429 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:45.559643 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f1528aec-1fd5-4a85-a1c5-30e088ee8429 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:45.561829 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f1528aec-1fd5-4a85-a1c5-30e088ee8429 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:45.568537 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f1528aec-1fd5-4a85-a1c5-30e088ee8429 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:45.712200 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f1528aec-1fd5-4a85-a1c5-30e088ee8429 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:45.720406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f1528aec-1fd5-4a85-a1c5-30e088ee8429 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1218 microversion: 2.1 time: 0.203497 Dec 15 19:03:45.724465 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 29/53] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:45 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:45.729764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1a8b0361-4321-4f79-96a7-285db2e1bfe3 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:45.730657 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1a8b0361-4321-4f79-96a7-285db2e1bfe3 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:45.745924 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1a8b0361-4321-4f79-96a7-285db2e1bfe3 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:45.748322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1a8b0361-4321-4f79-96a7-285db2e1bfe3 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:45.749847 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1a8b0361-4321-4f79-96a7-285db2e1bfe3 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:45.750838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1a8b0361-4321-4f79-96a7-285db2e1bfe3 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:45.860520 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1a8b0361-4321-4f79-96a7-285db2e1bfe3 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:45.872119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1a8b0361-4321-4f79-96a7-285db2e1bfe3 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1271 microversion: 2.1 time: 0.146495 Dec 15 19:03:45.875229 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 30/54] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:45 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:45.895339 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1717cd8c-27e5-4fef-8536-0c623b86de9e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:45.900748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1717cd8c-27e5-4fef-8536-0c623b86de9e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:45.908062 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1717cd8c-27e5-4fef-8536-0c623b86de9e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:45.908529 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1717cd8c-27e5-4fef-8536-0c623b86de9e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:45.914918 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1717cd8c-27e5-4fef-8536-0c623b86de9e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:45.942520 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1717cd8c-27e5-4fef-8536-0c623b86de9e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:46.132273 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1717cd8c-27e5-4fef-8536-0c623b86de9e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:46.140341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1717cd8c-27e5-4fef-8536-0c623b86de9e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1276 microversion: 2.1 time: 0.263977 Dec 15 19:03:46.151742 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 31/55] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:45 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1276 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:46.659533 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:03:46.660699 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:03:46.661451 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:03:46.662110 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:03:46.663568 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:03:46.681198 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:46.686757 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:46.687828 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:46.689615 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:46.732134 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:03:46.745468 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d8c640e7-8911-405b-af02-73371110e799 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:46.747025 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for user 497f05dbb53e48a38abf9529018d1766 and project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:03:46.750037 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d8c640e7-8911-405b-af02-73371110e799 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:46.760983 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8c640e7-8911-405b-af02-73371110e799 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:46.764535 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:03:46.770081 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:03:46.774590 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8c640e7-8911-405b-af02-73371110e799 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:46.787687 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8c640e7-8911-405b-af02-73371110e799 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:46.796648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8c640e7-8911-405b-af02-73371110e799 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:46.975525 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2dec10c5-c3cd-4daf-8509-ccd378247c1a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.086102 Dec 15 19:03:46.982276 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 25/56] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Dec 15 19:03:44 2021] POST /compute/v2.1/servers => generated 401 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 19:03:47.005356 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-78a0c1e2-a177-4c00-bdaf-de5c922a1bc5 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:47.008450 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-78a0c1e2-a177-4c00-bdaf-de5c922a1bc5 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:47.057300 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78a0c1e2-a177-4c00-bdaf-de5c922a1bc5 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:47.067675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78a0c1e2-a177-4c00-bdaf-de5c922a1bc5 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:47.070817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78a0c1e2-a177-4c00-bdaf-de5c922a1bc5 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:47.074903 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78a0c1e2-a177-4c00-bdaf-de5c922a1bc5 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:47.237669 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d8c640e7-8911-405b-af02-73371110e799 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:47.255261 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d8c640e7-8911-405b-af02-73371110e799 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1282 microversion: 2.1 time: 0.518066 Dec 15 19:03:47.271031 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 32/57] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:46 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1282 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:47.281709 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ae30269a-e93c-482f-ac39-1087c3c206ac tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:47.287558 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ae30269a-e93c-482f-ac39-1087c3c206ac tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:47.492154 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ae30269a-e93c-482f-ac39-1087c3c206ac tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:47.500168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ae30269a-e93c-482f-ac39-1087c3c206ac tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:47.508047 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ae30269a-e93c-482f-ac39-1087c3c206ac tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:47.509382 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ae30269a-e93c-482f-ac39-1087c3c206ac tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1278 microversion: 2.20 time: 0.236944 Dec 15 19:03:47.520863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 33/58] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:47 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:03:47.520863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e591b066-4ef6-4319-b27e-8d1ff3959cf8 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:47.520863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e591b066-4ef6-4319-b27e-8d1ff3959cf8 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:47.547167 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e591b066-4ef6-4319-b27e-8d1ff3959cf8 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:47.549513 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e591b066-4ef6-4319-b27e-8d1ff3959cf8 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:47.550608 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e591b066-4ef6-4319-b27e-8d1ff3959cf8 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:47.551208 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e591b066-4ef6-4319-b27e-8d1ff3959cf8 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:47.714860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-78a0c1e2-a177-4c00-bdaf-de5c922a1bc5 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:47.724000 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-78a0c1e2-a177-4c00-bdaf-de5c922a1bc5 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.740393 Dec 15 19:03:47.727237 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 26/59] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:46 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:47.768378 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e591b066-4ef6-4319-b27e-8d1ff3959cf8 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:47.779102 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e591b066-4ef6-4319-b27e-8d1ff3959cf8 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1276 microversion: 2.1 time: 0.267380 Dec 15 19:03:47.783561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 34/60] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:47 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1276 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:48.276584 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c5a61e89-5887-4dd7-b8ca-57728ecf218c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:48.277442 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c5a61e89-5887-4dd7-b8ca-57728ecf218c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:48.284511 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5a61e89-5887-4dd7-b8ca-57728ecf218c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:48.287884 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5a61e89-5887-4dd7-b8ca-57728ecf218c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:48.288909 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5a61e89-5887-4dd7-b8ca-57728ecf218c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:48.291116 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5a61e89-5887-4dd7-b8ca-57728ecf218c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:48.529327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ef2139a4-491f-459f-8e0d-773f3426c106 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:48.530518 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ef2139a4-491f-459f-8e0d-773f3426c106 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:48.581483 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c5a61e89-5887-4dd7-b8ca-57728ecf218c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:48.588169 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c5a61e89-5887-4dd7-b8ca-57728ecf218c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1280 microversion: 2.1 time: 0.315063 Dec 15 19:03:48.604481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 27/61] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:48 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1280 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:48.649924 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ef2139a4-491f-459f-8e0d-773f3426c106 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:48.654281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ef2139a4-491f-459f-8e0d-773f3426c106 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:48.662794 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ef2139a4-491f-459f-8e0d-773f3426c106 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:48.665438 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ef2139a4-491f-459f-8e0d-773f3426c106 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1278 microversion: 2.20 time: 0.140305 Dec 15 19:03:48.666944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 35/62] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:48 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1278 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:03:48.749359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-11252e6d-76bd-452a-b195-8fe5c7e36f1d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:48.751163 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-11252e6d-76bd-452a-b195-8fe5c7e36f1d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:48.761469 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-11252e6d-76bd-452a-b195-8fe5c7e36f1d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:48.762186 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-11252e6d-76bd-452a-b195-8fe5c7e36f1d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:48.763010 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-11252e6d-76bd-452a-b195-8fe5c7e36f1d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:48.763464 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-11252e6d-76bd-452a-b195-8fe5c7e36f1d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:48.800764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9cb95e57-be03-440b-9edc-76142e46b9a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:48.802464 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9cb95e57-be03-440b-9edc-76142e46b9a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:48.824088 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cb95e57-be03-440b-9edc-76142e46b9a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:48.826385 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cb95e57-be03-440b-9edc-76142e46b9a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:48.827554 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cb95e57-be03-440b-9edc-76142e46b9a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:48.828017 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cb95e57-be03-440b-9edc-76142e46b9a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:49.182926 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-11252e6d-76bd-452a-b195-8fe5c7e36f1d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:49.197262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-11252e6d-76bd-452a-b195-8fe5c7e36f1d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.453400 Dec 15 19:03:49.203188 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 28/63] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:48 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:49.223413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9cb95e57-be03-440b-9edc-76142e46b9a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:49.241365 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9cb95e57-be03-440b-9edc-76142e46b9a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.436808 Dec 15 19:03:49.242224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 36/64] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:48 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:03:49.620543 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4c4cd996-fbc2-4138-b33f-5a20934cb991 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:49.621494 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4c4cd996-fbc2-4138-b33f-5a20934cb991 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:49.629666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4c4cd996-fbc2-4138-b33f-5a20934cb991 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:49.630101 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4c4cd996-fbc2-4138-b33f-5a20934cb991 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:49.633136 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4c4cd996-fbc2-4138-b33f-5a20934cb991 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:49.633777 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4c4cd996-fbc2-4138-b33f-5a20934cb991 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:49.684470 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:49.685111 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:49.695344 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:49.695807 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:49.697962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:49.699531 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:49.790778 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4c4cd996-fbc2-4138-b33f-5a20934cb991 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:49.816771 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4c4cd996-fbc2-4138-b33f-5a20934cb991 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1280 microversion: 2.1 time: 0.186546 Dec 15 19:03:49.818291 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 29/65] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:49 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1280 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:03:49.860180 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:49.868362 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:49.871476 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:49.871476 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-492d983a-48d6-490e-ac5c-4a31bede9b3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1282 microversion: 2.20 time: 0.191023 Dec 15 19:03:49.881457 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 37/66] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:49 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:03:50.219378 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ecb9c548-2e43-4000-a090-913101e614fc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:50.220270 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ecb9c548-2e43-4000-a090-913101e614fc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:50.227925 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecb9c548-2e43-4000-a090-913101e614fc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.234905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecb9c548-2e43-4000-a090-913101e614fc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.235779 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecb9c548-2e43-4000-a090-913101e614fc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.236231 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecb9c548-2e43-4000-a090-913101e614fc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.457564 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-77ccdf17-f5e9-4d1d-836f-ba190e6b6a61 req-d311b07f-5436-4269-aac3-4bf4b43f282a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a4a770-fe68-4180-b052-5b7161dd2293", "tag": "891fcb6e-7400-455c-824c-1bcd8f750785"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:50.460089 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:03:50.460089 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:03:50.472144 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-77ccdf17-f5e9-4d1d-836f-ba190e6b6a61 req-d311b07f-5436-4269-aac3-4bf4b43f282a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.472819 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-77ccdf17-f5e9-4d1d-836f-ba190e6b6a61 req-d311b07f-5436-4269-aac3-4bf4b43f282a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.495049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-77ccdf17-f5e9-4d1d-836f-ba190e6b6a61 req-d311b07f-5436-4269-aac3-4bf4b43f282a service nova] Creating event network-changed:891fcb6e-7400-455c-824c-1bcd8f750785 for instance 11a4a770-fe68-4180-b052-5b7161dd2293 on hv-cinder-81268 Dec 15 19:03:50.495888 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-77ccdf17-f5e9-4d1d-836f-ba190e6b6a61 req-d311b07f-5436-4269-aac3-4bf4b43f282a service nova] Acquired lock "compute-rpcapi-router" {{(pid=116515) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 19:03:50.497232 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1d6ca58-3a17-4455-8d1d-4e57bd540e63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.497846 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1d6ca58-3a17-4455-8d1d-4e57bd540e63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.498654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1d6ca58-3a17-4455-8d1d-4e57bd540e63 None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.499251 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1d6ca58-3a17-4455-8d1d-4e57bd540e63 None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.508776 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.compute.rpcapi [None req-d1d6ca58-3a17-4455-8d1d-4e57bd540e63 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 19:03:50.510745 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1d6ca58-3a17-4455-8d1d-4e57bd540e63 None None] Releasing lock "compute-rpcapi-router" {{(pid=116515) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 19:03:50.519168 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ecb9c548-2e43-4000-a090-913101e614fc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:50.527200 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ecb9c548-2e43-4000-a090-913101e614fc tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.312460 Dec 15 19:03:50.532128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 30/67] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:50 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:50.540278 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-19356b19-9a2c-4b38-a7df-49b81b4bc3c9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:50.540921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-19356b19-9a2c-4b38-a7df-49b81b4bc3c9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:50.552893 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-19356b19-9a2c-4b38-a7df-49b81b4bc3c9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.553612 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-19356b19-9a2c-4b38-a7df-49b81b4bc3c9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.554593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-19356b19-9a2c-4b38-a7df-49b81b4bc3c9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.555175 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-19356b19-9a2c-4b38-a7df-49b81b4bc3c9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.572691 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d1d6ca58-3a17-4455-8d1d-4e57bd540e63 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312326 Dec 15 19:03:50.572691 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 38/68] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:03:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:50.738191 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-19356b19-9a2c-4b38-a7df-49b81b4bc3c9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:50.746147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-19356b19-9a2c-4b38-a7df-49b81b4bc3c9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.216348 Dec 15 19:03:50.753121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 31/69] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:50 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:50.835184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-17163bcf-510b-45b0-a1bd-716871e63d96 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:50.836326 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-17163bcf-510b-45b0-a1bd-716871e63d96 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:50.843499 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-17163bcf-510b-45b0-a1bd-716871e63d96 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.844060 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-17163bcf-510b-45b0-a1bd-716871e63d96 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.845027 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-17163bcf-510b-45b0-a1bd-716871e63d96 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.845574 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-17163bcf-510b-45b0-a1bd-716871e63d96 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.890567 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:50.892748 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:50.899366 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.900144 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.900948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:50.901420 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:50.972376 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:50.981582 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:50.983671 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:50.984534 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f04786c9-942e-4568-925b-7e5bcf559c27 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1282 microversion: 2.20 time: 0.098230 Dec 15 19:03:50.995952 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 32/70] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:50 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:03:51.128990 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-17163bcf-510b-45b0-a1bd-716871e63d96 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:51.138066 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-17163bcf-510b-45b0-a1bd-716871e63d96 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.306877 Dec 15 19:03:51.140204 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 39/71] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:50 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:51.547375 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b0c0e04e-ab0d-43a0-b5df-15670fa18f11 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:51.548264 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b0c0e04e-ab0d-43a0-b5df-15670fa18f11 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:51.562292 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b0c0e04e-ab0d-43a0-b5df-15670fa18f11 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:51.563285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b0c0e04e-ab0d-43a0-b5df-15670fa18f11 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:51.564291 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b0c0e04e-ab0d-43a0-b5df-15670fa18f11 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:51.564729 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b0c0e04e-ab0d-43a0-b5df-15670fa18f11 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:51.758993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b0c0e04e-ab0d-43a0-b5df-15670fa18f11 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:51.758993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b0c0e04e-ab0d-43a0-b5df-15670fa18f11 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.206140 Dec 15 19:03:51.758993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 33/72] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:51 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:51.767686 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-14085611-1a90-4efb-a0ef-35013610ef7f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:51.768307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-14085611-1a90-4efb-a0ef-35013610ef7f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:51.775635 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-14085611-1a90-4efb-a0ef-35013610ef7f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:51.776184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-14085611-1a90-4efb-a0ef-35013610ef7f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:51.777117 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-14085611-1a90-4efb-a0ef-35013610ef7f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:51.777680 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-14085611-1a90-4efb-a0ef-35013610ef7f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:51.920226 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-14085611-1a90-4efb-a0ef-35013610ef7f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:51.928613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-14085611-1a90-4efb-a0ef-35013610ef7f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.165355 Dec 15 19:03:51.929258 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 40/73] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:51 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:52.004382 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:52.017020 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:52.025709 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:52.027183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:52.028281 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:52.028874 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:52.116709 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:52.125881 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:52.127497 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:52.128700 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bc2470cb-572f-421d-a28f-b43ec1c6626a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1282 microversion: 2.20 time: 0.129840 Dec 15 19:03:52.129382 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 34/74] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:51 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1282 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:03:52.155762 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-16f8eb23-e384-4192-a8bf-493e20bdb3b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:52.156406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-16f8eb23-e384-4192-a8bf-493e20bdb3b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:52.165941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-16f8eb23-e384-4192-a8bf-493e20bdb3b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:52.166397 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-16f8eb23-e384-4192-a8bf-493e20bdb3b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:52.167196 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-16f8eb23-e384-4192-a8bf-493e20bdb3b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:52.167633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-16f8eb23-e384-4192-a8bf-493e20bdb3b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:52.370935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-16f8eb23-e384-4192-a8bf-493e20bdb3b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:52.382163 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-16f8eb23-e384-4192-a8bf-493e20bdb3b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.230079 Dec 15 19:03:52.383262 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 41/75] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:52 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:52.828636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-423e0e07-a494-43b1-a12b-66a23ac1f90f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:52.828636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-423e0e07-a494-43b1-a12b-66a23ac1f90f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:52.828636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-423e0e07-a494-43b1-a12b-66a23ac1f90f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:52.828636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-423e0e07-a494-43b1-a12b-66a23ac1f90f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:52.829998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-423e0e07-a494-43b1-a12b-66a23ac1f90f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:52.829998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-423e0e07-a494-43b1-a12b-66a23ac1f90f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:52.927556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-423e0e07-a494-43b1-a12b-66a23ac1f90f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:52.934986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-423e0e07-a494-43b1-a12b-66a23ac1f90f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.160874 Dec 15 19:03:52.935544 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 35/76] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:52 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:52.945892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a5403073-840f-456e-8c28-eff078e929e7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:52.946602 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a5403073-840f-456e-8c28-eff078e929e7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:52.953242 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a5403073-840f-456e-8c28-eff078e929e7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:52.956713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a5403073-840f-456e-8c28-eff078e929e7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:52.956713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a5403073-840f-456e-8c28-eff078e929e7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:52.956713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a5403073-840f-456e-8c28-eff078e929e7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:53.154941 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:53.155686 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:53.167999 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a5403073-840f-456e-8c28-eff078e929e7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:53.168517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:53.168517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:53.168517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:53.168517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:53.171586 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a5403073-840f-456e-8c28-eff078e929e7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.229563 Dec 15 19:03:53.173620 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 42/77] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:52 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:53.177398 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-44dfa36b-adbc-458f-b83b-5d60fe74db6c tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b65eba60>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:53.255978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-44dfa36b-adbc-458f-b83b-5d60fe74db6c tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/43034d19-e0d9-490f-bc46-2951bfe847d6" status: 200 len: 350 microversion: 2.1 time: 0.078851 Dec 15 19:03:53.255978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 43/78] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:53 2021] GET /compute/v2.1/os-volumes/43034d19-e0d9-490f-bc46-2951bfe847d6 => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:53.271260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:53.284267 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:53.286296 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:53.287730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fa052c23-9354-448f-8b09-b17e412230c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1282 microversion: 2.20 time: 0.137521 Dec 15 19:03:53.302085 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 36/79] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:53 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:03:53.401701 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-87636e2a-b916-4260-a9dd-bfc5e709cf4f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:53.403364 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-87636e2a-b916-4260-a9dd-bfc5e709cf4f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:53.416276 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87636e2a-b916-4260-a9dd-bfc5e709cf4f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:53.416741 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87636e2a-b916-4260-a9dd-bfc5e709cf4f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:53.421931 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87636e2a-b916-4260-a9dd-bfc5e709cf4f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:53.423229 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87636e2a-b916-4260-a9dd-bfc5e709cf4f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:53.765510 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-87636e2a-b916-4260-a9dd-bfc5e709cf4f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:53.772810 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-87636e2a-b916-4260-a9dd-bfc5e709cf4f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.376362 Dec 15 19:03:53.782071 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 44/80] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:53 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:53.952827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ddc9d3bf-ea8d-44ba-8a7d-0ebddecdd8af tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:53.954887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ddc9d3bf-ea8d-44ba-8a7d-0ebddecdd8af tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:53.960752 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ddc9d3bf-ea8d-44ba-8a7d-0ebddecdd8af tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:53.961416 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ddc9d3bf-ea8d-44ba-8a7d-0ebddecdd8af tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:53.962548 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ddc9d3bf-ea8d-44ba-8a7d-0ebddecdd8af tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:53.963162 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ddc9d3bf-ea8d-44ba-8a7d-0ebddecdd8af tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:54.182295 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ddc9d3bf-ea8d-44ba-8a7d-0ebddecdd8af tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:54.193708 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f3a9eb33-af6d-4665-8d96-92cfc9d3e053 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:54.193708 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f3a9eb33-af6d-4665-8d96-92cfc9d3e053 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:54.198419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ddc9d3bf-ea8d-44ba-8a7d-0ebddecdd8af tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.250293 Dec 15 19:03:54.200758 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 37/81] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:53 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:54.219727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3a9eb33-af6d-4665-8d96-92cfc9d3e053 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:54.219727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3a9eb33-af6d-4665-8d96-92cfc9d3e053 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:54.219727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3a9eb33-af6d-4665-8d96-92cfc9d3e053 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:54.219727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3a9eb33-af6d-4665-8d96-92cfc9d3e053 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:54.312091 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:54.312846 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:54.322237 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:54.322696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:54.333505 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:54.334895 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:54.416652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f3a9eb33-af6d-4665-8d96-92cfc9d3e053 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:54.432133 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f3a9eb33-af6d-4665-8d96-92cfc9d3e053 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.244348 Dec 15 19:03:54.432722 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 45/82] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:54 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:54.467835 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:54.595317 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:54.595317 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:54.595317 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2005a054-292b-4ff9-9430-7d578e14a725 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1282 microversion: 2.20 time: 0.174001 Dec 15 19:03:54.596888 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 38/83] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:54 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:03:54.801318 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0a6f65fd-b959-4796-85ac-3c613dc10ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:54.802157 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0a6f65fd-b959-4796-85ac-3c613dc10ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:54.816627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0a6f65fd-b959-4796-85ac-3c613dc10ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:54.817096 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0a6f65fd-b959-4796-85ac-3c613dc10ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:54.817946 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0a6f65fd-b959-4796-85ac-3c613dc10ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:54.818382 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0a6f65fd-b959-4796-85ac-3c613dc10ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:54.976832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0a6f65fd-b959-4796-85ac-3c613dc10ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:54.980481 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0a6f65fd-b959-4796-85ac-3c613dc10ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.187567 Dec 15 19:03:54.981219 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 46/84] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:54 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:55.218037 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a74ed0d9-2f7d-4159-baa0-7338f2852384 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:55.218896 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a74ed0d9-2f7d-4159-baa0-7338f2852384 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:55.230698 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a74ed0d9-2f7d-4159-baa0-7338f2852384 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:55.231152 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a74ed0d9-2f7d-4159-baa0-7338f2852384 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:55.236859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a74ed0d9-2f7d-4159-baa0-7338f2852384 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:55.237693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a74ed0d9-2f7d-4159-baa0-7338f2852384 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:55.386497 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a74ed0d9-2f7d-4159-baa0-7338f2852384 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:55.394131 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a74ed0d9-2f7d-4159-baa0-7338f2852384 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.179695 Dec 15 19:03:55.408053 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 39/85] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:55 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:55.448584 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d0b4e4cf-f8e9-44de-8671-873e9bdd1b06 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:55.449171 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d0b4e4cf-f8e9-44de-8671-873e9bdd1b06 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:55.455301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d0b4e4cf-f8e9-44de-8671-873e9bdd1b06 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:55.455747 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d0b4e4cf-f8e9-44de-8671-873e9bdd1b06 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:55.456512 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d0b4e4cf-f8e9-44de-8671-873e9bdd1b06 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:55.456938 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d0b4e4cf-f8e9-44de-8671-873e9bdd1b06 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:55.501535 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:55.506003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:55.518287 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:55.519123 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:55.520227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:55.521010 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:55.604224 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:55.612713 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:55.614297 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:55.615493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f61172c0-a9e2-4746-8949-3b3113d2dd6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1282 microversion: 2.20 time: 0.119540 Dec 15 19:03:55.616139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 40/86] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:55 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:03:55.616389 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d0b4e4cf-f8e9-44de-8671-873e9bdd1b06 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:55.623661 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d0b4e4cf-f8e9-44de-8671-873e9bdd1b06 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.178814 Dec 15 19:03:55.624222 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 47/87] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:55 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:55.754816 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9ee881ca-9ec7-4fca-ae08-248566e14e65 tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b65055e0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:55.819522 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9ee881ca-9ec7-4fca-ae08-248566e14e65 tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b64a2343-c8be-45ee-bcd3-036028f516da" status: 200 len: 351 microversion: 2.1 time: 0.068171 Dec 15 19:03:55.820395 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 41/88] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:55 2021] GET /compute/v2.1/os-volumes/b64a2343-c8be-45ee-bcd3-036028f516da => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:55.998160 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f5256a5f-20c9-4379-8f90-1172b3536e5e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:55.998706 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f5256a5f-20c9-4379-8f90-1172b3536e5e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:56.004484 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f5256a5f-20c9-4379-8f90-1172b3536e5e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:56.005059 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f5256a5f-20c9-4379-8f90-1172b3536e5e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:56.006072 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f5256a5f-20c9-4379-8f90-1172b3536e5e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:56.006513 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f5256a5f-20c9-4379-8f90-1172b3536e5e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:56.229050 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f5256a5f-20c9-4379-8f90-1172b3536e5e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:56.237961 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f5256a5f-20c9-4379-8f90-1172b3536e5e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.243151 Dec 15 19:03:56.249324 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 48/89] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:55 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:56.423236 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-04ad87ab-f09d-400c-8286-75c304855f80 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:56.423842 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-04ad87ab-f09d-400c-8286-75c304855f80 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:56.430190 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-04ad87ab-f09d-400c-8286-75c304855f80 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:56.430859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-04ad87ab-f09d-400c-8286-75c304855f80 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:56.431659 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-04ad87ab-f09d-400c-8286-75c304855f80 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:56.432097 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-04ad87ab-f09d-400c-8286-75c304855f80 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:56.594166 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-04ad87ab-f09d-400c-8286-75c304855f80 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:56.603803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-04ad87ab-f09d-400c-8286-75c304855f80 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.184717 Dec 15 19:03:56.604416 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 42/90] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:56 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:56.634737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:56.635482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:56.642206 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:56.645416 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:56.646326 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:56.646840 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:56.652728 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b895a4f8-cf05-4c88-a1e4-ffdb25d0b44e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:56.655711 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b895a4f8-cf05-4c88-a1e4-ffdb25d0b44e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:56.669167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b895a4f8-cf05-4c88-a1e4-ffdb25d0b44e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:56.669741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b895a4f8-cf05-4c88-a1e4-ffdb25d0b44e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:56.670624 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b895a4f8-cf05-4c88-a1e4-ffdb25d0b44e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:56.671132 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b895a4f8-cf05-4c88-a1e4-ffdb25d0b44e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:56.751477 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:56.766406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:56.768203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:56.769490 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7857dece-2c55-4acc-bea8-6069df01362e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1282 microversion: 2.20 time: 0.139545 Dec 15 19:03:56.770220 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 49/91] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:56 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:03:56.862773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b895a4f8-cf05-4c88-a1e4-ffdb25d0b44e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:56.886890 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b895a4f8-cf05-4c88-a1e4-ffdb25d0b44e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.233811 Dec 15 19:03:56.886890 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 43/92] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:56 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:57.297953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-035395bf-81e3-422f-8393-3ea8229e0de9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:57.298634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-035395bf-81e3-422f-8393-3ea8229e0de9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:57.304783 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-035395bf-81e3-422f-8393-3ea8229e0de9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:57.305266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-035395bf-81e3-422f-8393-3ea8229e0de9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:57.306045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-035395bf-81e3-422f-8393-3ea8229e0de9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:57.306493 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-035395bf-81e3-422f-8393-3ea8229e0de9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:57.440600 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-035395bf-81e3-422f-8393-3ea8229e0de9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:57.447835 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-035395bf-81e3-422f-8393-3ea8229e0de9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.153556 Dec 15 19:03:57.448383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 50/93] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:57 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:03:57.620945 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e577a9fe-dc26-4b27-86f5-b3db0984b7d4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:57.621907 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e577a9fe-dc26-4b27-86f5-b3db0984b7d4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:57.628025 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e577a9fe-dc26-4b27-86f5-b3db0984b7d4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:57.628529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e577a9fe-dc26-4b27-86f5-b3db0984b7d4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:57.629341 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e577a9fe-dc26-4b27-86f5-b3db0984b7d4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:57.629769 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e577a9fe-dc26-4b27-86f5-b3db0984b7d4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:57.760337 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e577a9fe-dc26-4b27-86f5-b3db0984b7d4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:57.779221 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e577a9fe-dc26-4b27-86f5-b3db0984b7d4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.151421 Dec 15 19:03:57.779221 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 44/94] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:57 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:57.789072 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:57.795798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:57.803751 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:57.804180 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:57.805106 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:57.805429 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:57.845878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4cdf2756-2b71-49e0-9c51-d6ebf3ebad6c tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b65a3b80>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:57.896720 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4cdf2756-2b71-49e0-9c51-d6ebf3ebad6c tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/56832b42-d93c-4aca-9dc3-b61d6e7d58dc" status: 200 len: 350 microversion: 2.1 time: 0.054483 Dec 15 19:03:57.897539 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 45/95] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:03:57 2021] GET /compute/v2.1/os-volumes/56832b42-d93c-4aca-9dc3-b61d6e7d58dc => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:03:57.908877 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ce199d32-a8c1-4289-8d90-8ee4b9f1f9bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:57.909643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ce199d32-a8c1-4289-8d90-8ee4b9f1f9bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:57.916039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ce199d32-a8c1-4289-8d90-8ee4b9f1f9bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:57.916640 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ce199d32-a8c1-4289-8d90-8ee4b9f1f9bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:57.917601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ce199d32-a8c1-4289-8d90-8ee4b9f1f9bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:57.918169 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ce199d32-a8c1-4289-8d90-8ee4b9f1f9bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:57.923798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:57.948340 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:57.953435 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:57.957123 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-adbf26bd-c4a8-48a9-bbc2-3f11496d972a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1282 microversion: 2.20 time: 0.173665 Dec 15 19:03:57.961981 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 51/96] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:57 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:03:57.968199 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ef47418f-b8ea-4f81-87a9-360b6eaa7a91 tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b5cdd550>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.183674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ef47418f-b8ea-4f81-87a9-360b6eaa7a91 tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.219807 Dec 15 19:03:58.184480 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 52/97] 10.222.0.49 () {58 vars in 1133 bytes} [Wed Dec 15 19:03:57 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:58.205275 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3546d053-1872-4122-8282-6a94640c71ec tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b5d0f040>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.313015 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3546d053-1872-4122-8282-6a94640c71ec tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.112464 Dec 15 19:03:58.313753 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 53/98] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:58.326103 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-80aca282-1206-4f46-b7b3-2f4de9e9a0de tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b5c96280>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.413758 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-80aca282-1206-4f46-b7b3-2f4de9e9a0de tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091551 Dec 15 19:03:58.414326 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 54/99] 10.222.0.49 () {58 vars in 1133 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:58.425329 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7893ee3c-52c9-40a6-a47b-80525af27ffc tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b5cedaf0>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.513922 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7893ee3c-52c9-40a6-a47b-80525af27ffc tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092151 Dec 15 19:03:58.514514 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 55/100] 10.222.0.49 () {58 vars in 1166 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:03:58.525727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c5f2f4a1-8934-4eb7-81b5-125e8757734e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.527843 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c5f2f4a1-8934-4eb7-81b5-125e8757734e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:58.532918 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5f2f4a1-8934-4eb7-81b5-125e8757734e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:58.533488 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5f2f4a1-8934-4eb7-81b5-125e8757734e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:58.534282 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5f2f4a1-8934-4eb7-81b5-125e8757734e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:58.534801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5f2f4a1-8934-4eb7-81b5-125e8757734e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:58.535544 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ce199d32-a8c1-4289-8d90-8ee4b9f1f9bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:58.543645 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ce199d32-a8c1-4289-8d90-8ee4b9f1f9bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.638843 Dec 15 19:03:58.544225 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 46/101] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:57 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:58.551328 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9ea82337-551c-4306-bf6e-6c7c9b2bc94b tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b6574c10>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.635470 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9ea82337-551c-4306-bf6e-6c7c9b2bc94b tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088514 Dec 15 19:03:58.636852 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 47/102] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:58.649479 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-24fd7464-ee83-4fe9-9beb-f28a9ebe06f2 tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b6505940>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.735245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-24fd7464-ee83-4fe9-9beb-f28a9ebe06f2 tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089285 Dec 15 19:03:58.735810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 48/103] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:03:58.746779 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5fe16ed3-d6dc-40ac-9fa0-fd0e82bb43e8 tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b6570af0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.833398 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5fe16ed3-d6dc-40ac-9fa0-fd0e82bb43e8 tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087467 Dec 15 19:03:58.838094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 49/104] 10.222.0.49 () {58 vars in 1187 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:03:58.841327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c5f2f4a1-8934-4eb7-81b5-125e8757734e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:58.845326 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-98d25b4e-222c-43ce-b1a7-0d5bc123f87b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.845943 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-98d25b4e-222c-43ce-b1a7-0d5bc123f87b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:58.849194 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c5f2f4a1-8934-4eb7-81b5-125e8757734e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.330708 Dec 15 19:03:58.849844 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 56/105] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:58.854297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3d9d4f8d-17ce-4984-9cc8-20fdfa4ce1fc tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] Calling method '.version_select at 0x7f80b659e5e0>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.861195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-98d25b4e-222c-43ce-b1a7-0d5bc123f87b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:58.861645 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-98d25b4e-222c-43ce-b1a7-0d5bc123f87b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:58.862856 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-98d25b4e-222c-43ce-b1a7-0d5bc123f87b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:58.863322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-98d25b4e-222c-43ce-b1a7-0d5bc123f87b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:58.940389 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3d9d4f8d-17ce-4984-9cc8-20fdfa4ce1fc tempest-VolumesTestJSON-1141299875 tempest-VolumesTestJSON-1141299875-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089300 Dec 15 19:03:58.943833 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 57/106] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:58.979303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:58.979913 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:58.990790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:58.990790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:58.990790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:58.990790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:59.095142 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-98d25b4e-222c-43ce-b1a7-0d5bc123f87b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:59.104628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-98d25b4e-222c-43ce-b1a7-0d5bc123f87b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.264807 Dec 15 19:03:59.105635 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 50/107] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:59.114653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:59.127188 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:59.130668 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:59.132230 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4b7d10cf-68e5-4b64-8a4b-1d0ff7aed5c8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1274 microversion: 2.20 time: 0.156816 Dec 15 19:03:59.133729 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 58/108] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:03:58 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:03:59.521016 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-20028516-ab1a-4b97-8d9b-f9417ed86930 req-68d3829b-0462-49d0-a60d-7503a46eefce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f130e2-e041-400a-934f-9c837ba505ef", "tag": "314bc344-bc90-4467-84d5-ab3c08f0f363"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:59.523139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:03:59.523139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:03:59.532615 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-20028516-ab1a-4b97-8d9b-f9417ed86930 req-68d3829b-0462-49d0-a60d-7503a46eefce service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:59.533129 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-20028516-ab1a-4b97-8d9b-f9417ed86930 req-68d3829b-0462-49d0-a60d-7503a46eefce service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:59.552575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-20028516-ab1a-4b97-8d9b-f9417ed86930 req-68d3829b-0462-49d0-a60d-7503a46eefce service nova] Creating event network-changed:314bc344-bc90-4467-84d5-ab3c08f0f363 for instance 93f130e2-e041-400a-934f-9c837ba505ef on hv-cinder-81268 Dec 15 19:03:59.553115 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-20028516-ab1a-4b97-8d9b-f9417ed86930 req-68d3829b-0462-49d0-a60d-7503a46eefce service nova] Acquired lock "compute-rpcapi-router" {{(pid=116514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 19:03:59.554234 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-02c35dcb-2702-4f19-ac47-4708f74b3c3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:59.554664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-02c35dcb-2702-4f19-ac47-4708f74b3c3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:59.555457 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-02c35dcb-2702-4f19-ac47-4708f74b3c3a None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:59.555878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-02c35dcb-2702-4f19-ac47-4708f74b3c3a None None] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:59.565023 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.compute.rpcapi [None req-02c35dcb-2702-4f19-ac47-4708f74b3c3a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 19:03:59.565919 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-02c35dcb-2702-4f19-ac47-4708f74b3c3a None None] Releasing lock "compute-rpcapi-router" {{(pid=116514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 19:03:59.591975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-02c35dcb-2702-4f19-ac47-4708f74b3c3a None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074397 Dec 15 19:03:59.592578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 51/109] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:03:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:59.597676 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e56e7f67-8873-4e05-8861-eff0dc15ae80 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:59.598376 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e56e7f67-8873-4e05-8861-eff0dc15ae80 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:59.604553 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e56e7f67-8873-4e05-8861-eff0dc15ae80 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:59.605003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e56e7f67-8873-4e05-8861-eff0dc15ae80 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:59.605819 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e56e7f67-8873-4e05-8861-eff0dc15ae80 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:59.606259 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e56e7f67-8873-4e05-8861-eff0dc15ae80 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:59.619196 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-098f3741-ea44-4792-95ee-e361c002d00c req-9c8f8aab-ee1c-452b-b3b2-fe2b735fb512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f02ea25-0aca-4414-a953-d09699b8d014", "tag": "98ba3766-39b5-4cc8-b78b-7acb892ea611"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:03:59.620913 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:03:59.620913 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:03:59.629113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-098f3741-ea44-4792-95ee-e361c002d00c req-9c8f8aab-ee1c-452b-b3b2-fe2b735fb512 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:59.629622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-098f3741-ea44-4792-95ee-e361c002d00c req-9c8f8aab-ee1c-452b-b3b2-fe2b735fb512 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:59.640310 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-098f3741-ea44-4792-95ee-e361c002d00c req-9c8f8aab-ee1c-452b-b3b2-fe2b735fb512 service nova] Creating event network-changed:98ba3766-39b5-4cc8-b78b-7acb892ea611 for instance 0f02ea25-0aca-4414-a953-d09699b8d014 on hv-cinder-81268 Dec 15 19:03:59.645259 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-098f3741-ea44-4792-95ee-e361c002d00c req-9c8f8aab-ee1c-452b-b3b2-fe2b735fb512 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090019 Dec 15 19:03:59.648165 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 59/110] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:03:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:03:59.740241 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e56e7f67-8873-4e05-8861-eff0dc15ae80 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:03:59.747460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e56e7f67-8873-4e05-8861-eff0dc15ae80 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.153568 Dec 15 19:03:59.748019 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 52/111] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:59 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:03:59.866526 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bb1f8c4d-95eb-485b-99d6-6a39eb3d16fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:03:59.867158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bb1f8c4d-95eb-485b-99d6-6a39eb3d16fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:03:59.873202 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb1f8c4d-95eb-485b-99d6-6a39eb3d16fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:59.873656 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb1f8c4d-95eb-485b-99d6-6a39eb3d16fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:03:59.874430 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb1f8c4d-95eb-485b-99d6-6a39eb3d16fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:03:59.874869 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb1f8c4d-95eb-485b-99d6-6a39eb3d16fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:00.002201 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bb1f8c4d-95eb-485b-99d6-6a39eb3d16fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:00.009320 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bb1f8c4d-95eb-485b-99d6-6a39eb3d16fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.146821 Dec 15 19:04:00.010135 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 60/112] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:03:59 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:00.121693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0703a379-00cd-40bb-9c10-7b999ddcfaca tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:00.122370 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0703a379-00cd-40bb-9c10-7b999ddcfaca tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:00.129541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0703a379-00cd-40bb-9c10-7b999ddcfaca tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:00.129991 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0703a379-00cd-40bb-9c10-7b999ddcfaca tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:00.130766 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0703a379-00cd-40bb-9c10-7b999ddcfaca tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:00.131198 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0703a379-00cd-40bb-9c10-7b999ddcfaca tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:00.151413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:00.152007 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:00.158215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:00.158658 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:00.159426 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:00.159853 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:00.222860 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:00.230602 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:00.232120 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:00.233270 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-dd784e50-df51-47b9-b2d6-0b6adb0b197c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1274 microversion: 2.20 time: 0.085477 Dec 15 19:04:00.234032 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 61/113] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:00 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:04:00.273405 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0703a379-00cd-40bb-9c10-7b999ddcfaca tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:00.280671 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0703a379-00cd-40bb-9c10-7b999ddcfaca tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.162663 Dec 15 19:04:00.282023 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 53/114] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:00 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:00.764654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-21bbf884-421f-40bb-87ea-62816cad60ea tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:00.765306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-21bbf884-421f-40bb-87ea-62816cad60ea tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:00.771191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-21bbf884-421f-40bb-87ea-62816cad60ea tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:00.771637 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-21bbf884-421f-40bb-87ea-62816cad60ea tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:00.772406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-21bbf884-421f-40bb-87ea-62816cad60ea tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:00.772835 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-21bbf884-421f-40bb-87ea-62816cad60ea tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:00.914659 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-21bbf884-421f-40bb-87ea-62816cad60ea tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:00.923810 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-21bbf884-421f-40bb-87ea-62816cad60ea tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.162527 Dec 15 19:04:00.924627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 62/115] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:00 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:01.025851 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f643dfc6-a154-40b9-826b-780a1830f0b3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:01.026465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f643dfc6-a154-40b9-826b-780a1830f0b3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:01.032843 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f643dfc6-a154-40b9-826b-780a1830f0b3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:01.033456 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f643dfc6-a154-40b9-826b-780a1830f0b3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:01.034252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f643dfc6-a154-40b9-826b-780a1830f0b3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:01.034708 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f643dfc6-a154-40b9-826b-780a1830f0b3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:01.264570 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:01.266608 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:01.277404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:01.285262 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:01.292140 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:01.292140 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:01.521960 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f643dfc6-a154-40b9-826b-780a1830f0b3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:01.532226 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f643dfc6-a154-40b9-826b-780a1830f0b3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.509867 Dec 15 19:04:01.556316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 54/116] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:01 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:01.557503 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-39f3db13-172d-49b9-b67c-992e8ff60d3b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:01.559000 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-39f3db13-172d-49b9-b67c-992e8ff60d3b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:01.570346 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-39f3db13-172d-49b9-b67c-992e8ff60d3b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:01.577467 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-39f3db13-172d-49b9-b67c-992e8ff60d3b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:01.592923 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-39f3db13-172d-49b9-b67c-992e8ff60d3b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:01.592923 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-39f3db13-172d-49b9-b67c-992e8ff60d3b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:01.654373 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:01.669243 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:01.671195 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:01.672866 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d8f092ea-8da7-4384-8cce-00e36193bd55 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1330 microversion: 2.20 time: 0.425741 Dec 15 19:04:01.683256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 63/117] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:01 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1330 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:04:01.683256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-0b913f31-ecc9-4b0a-8aee-5d684be40015 req-7cb89dd5-1b8e-4b78-ab3c-0d0ef53a18db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0314d560-94f2-4a77-a4ba-e572c16baf83", "tag": "a45ea0ec-0077-419a-b2e9-6b0cc9fbca81"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:01.683256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:04:01.683256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:04:01.691460 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-0b913f31-ecc9-4b0a-8aee-5d684be40015 req-7cb89dd5-1b8e-4b78-ab3c-0d0ef53a18db service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:01.692014 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-0b913f31-ecc9-4b0a-8aee-5d684be40015 req-7cb89dd5-1b8e-4b78-ab3c-0d0ef53a18db service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:01.706289 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-0b913f31-ecc9-4b0a-8aee-5d684be40015 req-7cb89dd5-1b8e-4b78-ab3c-0d0ef53a18db service nova] Creating event network-changed:a45ea0ec-0077-419a-b2e9-6b0cc9fbca81 for instance 0314d560-94f2-4a77-a4ba-e572c16baf83 on hv-cinder-81268 Dec 15 19:04:01.711703 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-0b913f31-ecc9-4b0a-8aee-5d684be40015 req-7cb89dd5-1b8e-4b78-ab3c-0d0ef53a18db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034863 Dec 15 19:04:01.712639 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 64/118] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:04:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:04:01.942496 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5f7d9e53-3166-4ce4-be1a-262e9ac283a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:01.943254 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5f7d9e53-3166-4ce4-be1a-262e9ac283a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:01.951420 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f7d9e53-3166-4ce4-be1a-262e9ac283a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:01.955345 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f7d9e53-3166-4ce4-be1a-262e9ac283a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:01.956196 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f7d9e53-3166-4ce4-be1a-262e9ac283a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:01.956695 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f7d9e53-3166-4ce4-be1a-262e9ac283a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:02.340580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-39f3db13-172d-49b9-b67c-992e8ff60d3b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:02.341561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5f7d9e53-3166-4ce4-be1a-262e9ac283a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:02.348884 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5f7d9e53-3166-4ce4-be1a-262e9ac283a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.410794 Dec 15 19:04:02.366222 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-39f3db13-172d-49b9-b67c-992e8ff60d3b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.832192 Dec 15 19:04:02.369924 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 55/119] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:01 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:02.378168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 65/120] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:01 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:02.562924 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-850e8b96-f5e9-4438-b054-b2139b90cf75 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:02.563577 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-850e8b96-f5e9-4438-b054-b2139b90cf75 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:02.578304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-850e8b96-f5e9-4438-b054-b2139b90cf75 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:02.579454 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-850e8b96-f5e9-4438-b054-b2139b90cf75 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:02.580186 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-850e8b96-f5e9-4438-b054-b2139b90cf75 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:02.580851 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-850e8b96-f5e9-4438-b054-b2139b90cf75 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:02.691128 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:02.694806 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:02.698929 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:02.699376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:02.700345 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:02.700585 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:02.815549 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:02.823776 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:02.825310 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:02.826657 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d1856112-fe97-439e-986b-b0541d4f9e87 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1336 microversion: 2.20 time: 0.139898 Dec 15 19:04:02.827297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 66/121] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:02 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1336 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:03.020759 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-850e8b96-f5e9-4438-b054-b2139b90cf75 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:03.029386 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-850e8b96-f5e9-4438-b054-b2139b90cf75 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.470674 Dec 15 19:04:03.030074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 56/122] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:02 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:03.368040 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1e0d09c9-8cc7-4894-8aad-c146332c5563 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:03.369482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1e0d09c9-8cc7-4894-8aad-c146332c5563 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:03.376161 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e0d09c9-8cc7-4894-8aad-c146332c5563 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:03.381599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e0d09c9-8cc7-4894-8aad-c146332c5563 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:03.381599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e0d09c9-8cc7-4894-8aad-c146332c5563 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:03.381599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e0d09c9-8cc7-4894-8aad-c146332c5563 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:03.389868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8d3ceee0-bc30-4caf-93c7-7a41dd28bb66 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:03.390497 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8d3ceee0-bc30-4caf-93c7-7a41dd28bb66 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:03.404654 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8d3ceee0-bc30-4caf-93c7-7a41dd28bb66 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:03.405418 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8d3ceee0-bc30-4caf-93c7-7a41dd28bb66 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:03.406226 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8d3ceee0-bc30-4caf-93c7-7a41dd28bb66 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:03.406681 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8d3ceee0-bc30-4caf-93c7-7a41dd28bb66 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:03.563736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8d3ceee0-bc30-4caf-93c7-7a41dd28bb66 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:03.570696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8d3ceee0-bc30-4caf-93c7-7a41dd28bb66 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.184198 Dec 15 19:04:03.571414 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 57/123] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:03 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:03.640385 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1e0d09c9-8cc7-4894-8aad-c146332c5563 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:03.647789 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1e0d09c9-8cc7-4894-8aad-c146332c5563 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.283825 Dec 15 19:04:03.648370 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 67/124] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:03 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:03.844838 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:03.845559 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:03.851541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:03.852051 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:03.852894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:03.853426 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:03.987902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:04.000005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:04.001566 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:04.002742 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-600d3364-8139-4e66-9d1a-2db5da2da2dc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.162217 Dec 15 19:04:04.003227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 58/125] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:03 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:04.046136 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-db4bbfe9-8ca4-4762-847d-eb4088f14efd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:04.046748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-db4bbfe9-8ca4-4762-847d-eb4088f14efd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:04.052423 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-db4bbfe9-8ca4-4762-847d-eb4088f14efd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:04.052873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-db4bbfe9-8ca4-4762-847d-eb4088f14efd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:04.053685 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-db4bbfe9-8ca4-4762-847d-eb4088f14efd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:04.054119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-db4bbfe9-8ca4-4762-847d-eb4088f14efd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:04.186861 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-db4bbfe9-8ca4-4762-847d-eb4088f14efd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:04.194088 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-db4bbfe9-8ca4-4762-847d-eb4088f14efd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.151523 Dec 15 19:04:04.194655 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 68/126] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:04 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:04.587845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-132b9031-2bde-4659-9af2-dffe5f3e3d3d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:04.588445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-132b9031-2bde-4659-9af2-dffe5f3e3d3d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:04.594957 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-132b9031-2bde-4659-9af2-dffe5f3e3d3d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:04.599513 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-132b9031-2bde-4659-9af2-dffe5f3e3d3d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:04.599513 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-132b9031-2bde-4659-9af2-dffe5f3e3d3d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:04.599513 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-132b9031-2bde-4659-9af2-dffe5f3e3d3d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:04.665244 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-dbab9c1b-e640-4853-a1c7-f655142f78ba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:04.665802 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-dbab9c1b-e640-4853-a1c7-f655142f78ba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:04.672152 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dbab9c1b-e640-4853-a1c7-f655142f78ba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:04.672603 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dbab9c1b-e640-4853-a1c7-f655142f78ba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:04.673475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dbab9c1b-e640-4853-a1c7-f655142f78ba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:04.673912 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dbab9c1b-e640-4853-a1c7-f655142f78ba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:04.734908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-132b9031-2bde-4659-9af2-dffe5f3e3d3d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:04.742524 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-132b9031-2bde-4659-9af2-dffe5f3e3d3d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.158352 Dec 15 19:04:04.743100 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 59/127] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:04 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:04.808320 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-dbab9c1b-e640-4853-a1c7-f655142f78ba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:04.816467 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-dbab9c1b-e640-4853-a1c7-f655142f78ba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.154982 Dec 15 19:04:04.817031 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 69/128] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:04 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:05.020603 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:05.021228 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:05.027044 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:05.027481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:05.028258 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:05.028687 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:05.167345 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:05.175132 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:05.176631 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:05.177751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5b92a56c-fdf9-4bb3-a7af-12d332acda62 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.160813 Dec 15 19:04:05.178316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 60/129] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:05 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:05.210995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2ee8fa5c-23e4-4c0a-a404-fbc681125d01 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:05.211612 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2ee8fa5c-23e4-4c0a-a404-fbc681125d01 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:05.217386 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2ee8fa5c-23e4-4c0a-a404-fbc681125d01 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:05.217839 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2ee8fa5c-23e4-4c0a-a404-fbc681125d01 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:05.218618 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2ee8fa5c-23e4-4c0a-a404-fbc681125d01 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:05.219057 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2ee8fa5c-23e4-4c0a-a404-fbc681125d01 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:05.349348 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-2ee8fa5c-23e4-4c0a-a404-fbc681125d01 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:05.356559 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2ee8fa5c-23e4-4c0a-a404-fbc681125d01 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.149121 Dec 15 19:04:05.357144 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 70/130] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:05 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:05.759304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7da5514d-2572-45db-b3a6-98ddec3f3a54 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:05.760175 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7da5514d-2572-45db-b3a6-98ddec3f3a54 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:05.766039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7da5514d-2572-45db-b3a6-98ddec3f3a54 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:05.766489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7da5514d-2572-45db-b3a6-98ddec3f3a54 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:05.767269 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7da5514d-2572-45db-b3a6-98ddec3f3a54 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:05.767749 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7da5514d-2572-45db-b3a6-98ddec3f3a54 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:05.833199 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fcde62e5-386a-4d6b-a54f-a18c75d66b59 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:05.833824 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fcde62e5-386a-4d6b-a54f-a18c75d66b59 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:05.839479 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcde62e5-386a-4d6b-a54f-a18c75d66b59 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:05.839928 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcde62e5-386a-4d6b-a54f-a18c75d66b59 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:05.840707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcde62e5-386a-4d6b-a54f-a18c75d66b59 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:05.841169 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcde62e5-386a-4d6b-a54f-a18c75d66b59 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:05.899661 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7da5514d-2572-45db-b3a6-98ddec3f3a54 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:05.907557 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7da5514d-2572-45db-b3a6-98ddec3f3a54 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.151934 Dec 15 19:04:05.908135 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 61/131] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:05 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:05.968680 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fcde62e5-386a-4d6b-a54f-a18c75d66b59 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:05.975735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fcde62e5-386a-4d6b-a54f-a18c75d66b59 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.146277 Dec 15 19:04:05.976299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 71/132] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:05 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:06.195817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:06.196413 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:06.202198 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:06.203262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:06.204064 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:06.204488 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:06.331372 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:06.339499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:06.340698 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:06.341855 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ab3ae876-3e61-4b23-9e5f-d229a7cd479e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.149751 Dec 15 19:04:06.342413 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 62/133] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:06 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:06.373773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-84e77c62-6f92-44fc-8340-14ae5a23ee2a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:06.373773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-84e77c62-6f92-44fc-8340-14ae5a23ee2a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:06.379849 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-84e77c62-6f92-44fc-8340-14ae5a23ee2a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:06.380286 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-84e77c62-6f92-44fc-8340-14ae5a23ee2a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:06.381049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-84e77c62-6f92-44fc-8340-14ae5a23ee2a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:06.381503 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-84e77c62-6f92-44fc-8340-14ae5a23ee2a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:06.510160 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-84e77c62-6f92-44fc-8340-14ae5a23ee2a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:06.517688 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-84e77c62-6f92-44fc-8340-14ae5a23ee2a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.148405 Dec 15 19:04:06.518253 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 72/134] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:06 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:06.923723 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-03262ae3-2ccc-40ff-b7b4-a2c566b87d13 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:06.926373 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-03262ae3-2ccc-40ff-b7b4-a2c566b87d13 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:06.931423 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-03262ae3-2ccc-40ff-b7b4-a2c566b87d13 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:06.932253 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-03262ae3-2ccc-40ff-b7b4-a2c566b87d13 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:06.933225 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-03262ae3-2ccc-40ff-b7b4-a2c566b87d13 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:06.933737 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-03262ae3-2ccc-40ff-b7b4-a2c566b87d13 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:06.993533 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d02eb48c-66cd-4f0a-8afb-830f05013c1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:06.994318 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d02eb48c-66cd-4f0a-8afb-830f05013c1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:07.001428 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d02eb48c-66cd-4f0a-8afb-830f05013c1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:07.002165 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d02eb48c-66cd-4f0a-8afb-830f05013c1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:07.002979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d02eb48c-66cd-4f0a-8afb-830f05013c1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:07.003417 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d02eb48c-66cd-4f0a-8afb-830f05013c1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:07.192541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-03262ae3-2ccc-40ff-b7b4-a2c566b87d13 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:07.200707 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-03262ae3-2ccc-40ff-b7b4-a2c566b87d13 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.280709 Dec 15 19:04:07.202966 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 63/135] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:06 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:07.231096 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d02eb48c-66cd-4f0a-8afb-830f05013c1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:07.239062 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d02eb48c-66cd-4f0a-8afb-830f05013c1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.249688 Dec 15 19:04:07.239638 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 73/136] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:06 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:07.359760 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:07.360965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:07.382578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:07.383520 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:07.384888 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:07.385519 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:07.400440 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-48edd546-bf42-4bea-8363-423a40e0926a req-d8ad11d9-33a4-4016-b0b0-c2dbc88cd2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93490542-6e11-41c3-9901-c06a1dd65cef", "tag": "2c56f2d3-88c3-4e37-b62b-41f5e58fee33"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:07.401971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:04:07.401971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:04:07.418311 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-48edd546-bf42-4bea-8363-423a40e0926a req-d8ad11d9-33a4-4016-b0b0-c2dbc88cd2fa service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:07.418764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-48edd546-bf42-4bea-8363-423a40e0926a req-d8ad11d9-33a4-4016-b0b0-c2dbc88cd2fa service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:07.434048 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-48edd546-bf42-4bea-8363-423a40e0926a req-d8ad11d9-33a4-4016-b0b0-c2dbc88cd2fa service nova] Creating event network-changed:2c56f2d3-88c3-4e37-b62b-41f5e58fee33 for instance 93490542-6e11-41c3-9901-c06a1dd65cef on hv-cinder-81268 Dec 15 19:04:07.444089 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-48edd546-bf42-4bea-8363-423a40e0926a req-d8ad11d9-33a4-4016-b0b0-c2dbc88cd2fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047191 Dec 15 19:04:07.445068 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 74/137] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:04:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:04:07.559928 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a7fb2fa6-4da4-463b-98da-43efae097f1c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:07.564933 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a7fb2fa6-4da4-463b-98da-43efae097f1c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:07.567919 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7fb2fa6-4da4-463b-98da-43efae097f1c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:07.568452 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7fb2fa6-4da4-463b-98da-43efae097f1c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:07.569361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7fb2fa6-4da4-463b-98da-43efae097f1c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:07.569887 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7fb2fa6-4da4-463b-98da-43efae097f1c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:07.802184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a7fb2fa6-4da4-463b-98da-43efae097f1c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:07.809581 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a7fb2fa6-4da4-463b-98da-43efae097f1c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.278405 Dec 15 19:04:07.811067 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 75/138] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:07 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:07.816331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:07.826648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:07.828171 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:07.829331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-dd348a5d-7e41-4c3e-b344-f368dd35f1b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.473517 Dec 15 19:04:07.830378 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 64/139] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:07 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:08.217338 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8eaeaf8a-a628-437f-8976-37f6c22b7dbf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:08.218037 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8eaeaf8a-a628-437f-8976-37f6c22b7dbf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:08.224406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8eaeaf8a-a628-437f-8976-37f6c22b7dbf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:08.224837 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8eaeaf8a-a628-437f-8976-37f6c22b7dbf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:08.225647 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8eaeaf8a-a628-437f-8976-37f6c22b7dbf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:08.226085 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8eaeaf8a-a628-437f-8976-37f6c22b7dbf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:08.261690 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-069c21a5-7df7-4d01-816c-ddea45219a32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:08.262435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-069c21a5-7df7-4d01-816c-ddea45219a32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:08.268865 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-069c21a5-7df7-4d01-816c-ddea45219a32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:08.269360 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-069c21a5-7df7-4d01-816c-ddea45219a32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:08.270166 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-069c21a5-7df7-4d01-816c-ddea45219a32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:08.270602 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-069c21a5-7df7-4d01-816c-ddea45219a32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:08.409714 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8eaeaf8a-a628-437f-8976-37f6c22b7dbf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:08.418545 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8eaeaf8a-a628-437f-8976-37f6c22b7dbf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.204881 Dec 15 19:04:08.419574 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 76/140] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:08 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:08.534396 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-069c21a5-7df7-4d01-816c-ddea45219a32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:08.543658 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-069c21a5-7df7-4d01-816c-ddea45219a32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.288981 Dec 15 19:04:08.546503 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 65/141] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:08 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:08.827748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-594b3596-f2f4-431e-b931-ff79bd57c132 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:08.828360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-594b3596-f2f4-431e-b931-ff79bd57c132 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:08.834282 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-594b3596-f2f4-431e-b931-ff79bd57c132 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:08.834735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-594b3596-f2f4-431e-b931-ff79bd57c132 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:08.835518 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-594b3596-f2f4-431e-b931-ff79bd57c132 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:08.835957 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-594b3596-f2f4-431e-b931-ff79bd57c132 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:08.849918 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:08.855329 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:08.876121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:08.876681 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:08.877610 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:08.878262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:08.998574 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-594b3596-f2f4-431e-b931-ff79bd57c132 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:09.012972 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-594b3596-f2f4-431e-b931-ff79bd57c132 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.188959 Dec 15 19:04:09.016578 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 77/142] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:08 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:09.063570 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:09.072246 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:09.073908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:09.075176 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ecf3222d-7dce-491c-9aaf-03d9ca36ea03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.231295 Dec 15 19:04:09.075820 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 66/143] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:08 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:04:09.438153 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-54bf15bb-a65d-492e-b321-37c8051bb81c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:09.439307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-54bf15bb-a65d-492e-b321-37c8051bb81c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:09.447777 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-54bf15bb-a65d-492e-b321-37c8051bb81c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:09.448406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-54bf15bb-a65d-492e-b321-37c8051bb81c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:09.449577 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-54bf15bb-a65d-492e-b321-37c8051bb81c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:09.450023 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-54bf15bb-a65d-492e-b321-37c8051bb81c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:09.600824 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-54bf15bb-a65d-492e-b321-37c8051bb81c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:09.605554 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-54bf15bb-a65d-492e-b321-37c8051bb81c tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.171252 Dec 15 19:04:09.606292 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 78/144] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:09 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:09.610451 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c047bb74-8656-49fc-b4a3-c42d42bd4695 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:09.611058 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c047bb74-8656-49fc-b4a3-c42d42bd4695 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:09.616692 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c047bb74-8656-49fc-b4a3-c42d42bd4695 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:09.617161 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c047bb74-8656-49fc-b4a3-c42d42bd4695 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:09.617927 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c047bb74-8656-49fc-b4a3-c42d42bd4695 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:09.618355 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c047bb74-8656-49fc-b4a3-c42d42bd4695 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:09.705196 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1fe2db07-b1e9-43c3-b2b6-7de372ad0c42 tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Action: 'create', calling method: .version_select at 0x7f80b652bd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-311480872", "metadata": {"Type": "work"}}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:09.708855 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1fe2db07-b1e9-43c3-b2b6-7de372ad0c42 tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:04:09.708855 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1fe2db07-b1e9-43c3-b2b6-7de372ad0c42 tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.195135 Dec 15 19:04:09.708855 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 67/145] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Dec 15 19:04:09 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 19:04:09.716742 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-79e6d074-40d0-4b0a-9876-a66a57e25930 tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Action: 'create', calling method: .version_select at 0x7f80b64ec0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2042480865", "metadata": {"Type": "work"}}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:09.718207 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-79e6d074-40d0-4b0a-9876-a66a57e25930 tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:04:09.718988 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-79e6d074-40d0-4b0a-9876-a66a57e25930 tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005847 Dec 15 19:04:09.719719 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 68/146] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Dec 15 19:04:09 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 19:04:09.729227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-48c096b0-15a9-40be-bc26-b72ac26fb13d tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Action: 'create', calling method: .version_select at 0x7f80b6e67a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1009104202", "metadata": {"Type": "work"}}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:09.730450 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-48c096b0-15a9-40be-bc26-b72ac26fb13d tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:04:09.731242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-48c096b0-15a9-40be-bc26-b72ac26fb13d tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006486 Dec 15 19:04:09.731768 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 69/147] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Dec 15 19:04:09 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 19:04:09.741570 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-89994843-3de3-43a2-8e6c-2f54fee2e0fd tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Calling method '.version_select at 0x7f80b654c1f0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:09.775063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-89994843-3de3-43a2-8e6c-2f54fee2e0fd tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] HTTP exception thrown: Volume tempest-invalid-1599646209 could not be found. Dec 15 19:04:09.775063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-89994843-3de3-43a2-8e6c-2f54fee2e0fd tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Returning 404 to user: Volume tempest-invalid-1599646209 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:04:09.775063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-89994843-3de3-43a2-8e6c-2f54fee2e0fd tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1599646209" status: 404 len: 99 microversion: 2.1 time: 0.035915 Dec 15 19:04:09.775063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 70/148] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Dec 15 19:04:09 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1599646209 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 15 19:04:09.784367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-30229d3f-8dd5-47da-a539-6c3b684ebd5a tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004609 Dec 15 19:04:09.788849 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 71/149] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Dec 15 19:04:09 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Dec 15 19:04:09.794547 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c0ceb95c-bceb-491a-a37d-a3ebac99aff6 tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003525 Dec 15 19:04:09.799348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 72/150] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Dec 15 19:04:09 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 19:04:09.804218 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-76b59e48-39cf-493f-b7a8-6de84fc06dee tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Calling method '.version_select at 0x7f80b654cf70>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:09.808964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c047bb74-8656-49fc-b4a3-c42d42bd4695 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:09.818368 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c047bb74-8656-49fc-b4a3-c42d42bd4695 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.211075 Dec 15 19:04:09.819025 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 79/151] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:09 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:09.833589 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-76b59e48-39cf-493f-b7a8-6de84fc06dee tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] HTTP exception thrown: Volume 03c5dd4c-95b5-4fe0-8f53-15824ca9ba00 could not be found. Dec 15 19:04:09.834238 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-76b59e48-39cf-493f-b7a8-6de84fc06dee tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Returning 404 to user: Volume 03c5dd4c-95b5-4fe0-8f53-15824ca9ba00 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:04:09.835327 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-76b59e48-39cf-493f-b7a8-6de84fc06dee tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/03c5dd4c-95b5-4fe0-8f53-15824ca9ba00" status: 404 len: 109 microversion: 2.1 time: 0.034817 Dec 15 19:04:09.835889 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 73/152] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Dec 15 19:04:09 2021] DELETE /compute/v2.1/os-volumes/03c5dd4c-95b5-4fe0-8f53-15824ca9ba00 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:04:09.846234 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-50483301-bad6-45e4-a8a6-0eb84d4ca31f tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Calling method '.version_select at 0x7f80b5cdde50>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:09.872064 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-50483301-bad6-45e4-a8a6-0eb84d4ca31f tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] HTTP exception thrown: Volume 70566c01-5460-4691-b444-11ac9f3d117a could not be found. Dec 15 19:04:09.872674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-50483301-bad6-45e4-a8a6-0eb84d4ca31f tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] Returning 404 to user: Volume 70566c01-5460-4691-b444-11ac9f3d117a could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:04:09.873545 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-50483301-bad6-45e4-a8a6-0eb84d4ca31f tempest-VolumesNegativeTest-1886591519 tempest-VolumesNegativeTest-1886591519-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/70566c01-5460-4691-b444-11ac9f3d117a" status: 404 len: 109 microversion: 2.1 time: 0.031006 Dec 15 19:04:09.874089 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 80/153] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Dec 15 19:04:09 2021] GET /compute/v2.1/os-volumes/70566c01-5460-4691-b444-11ac9f3d117a => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:04:10.032131 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-08c8fd09-313e-41d7-86aa-7ddcbb2d550d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:10.032769 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-08c8fd09-313e-41d7-86aa-7ddcbb2d550d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:10.039245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08c8fd09-313e-41d7-86aa-7ddcbb2d550d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:10.039696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08c8fd09-313e-41d7-86aa-7ddcbb2d550d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:10.040470 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08c8fd09-313e-41d7-86aa-7ddcbb2d550d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:10.040902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08c8fd09-313e-41d7-86aa-7ddcbb2d550d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:10.094418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:10.095052 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:10.101770 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:10.102437 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:10.103273 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:10.103712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:10.178233 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-08c8fd09-313e-41d7-86aa-7ddcbb2d550d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:10.188529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-08c8fd09-313e-41d7-86aa-7ddcbb2d550d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.159482 Dec 15 19:04:10.189112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 74/154] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:10 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:10.242146 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:10.249834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:10.252108 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:10.253242 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-311805db-f0ac-47da-8d77-0eedf693f768 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.162631 Dec 15 19:04:10.254097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 81/155] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:10 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:04:10.621401 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-db64a9a4-254e-48da-8830-115bf085b872 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:10.621996 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-db64a9a4-254e-48da-8830-115bf085b872 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:10.627830 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db64a9a4-254e-48da-8830-115bf085b872 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:10.628269 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db64a9a4-254e-48da-8830-115bf085b872 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:10.629037 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db64a9a4-254e-48da-8830-115bf085b872 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:10.629493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db64a9a4-254e-48da-8830-115bf085b872 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:10.838471 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-db64a9a4-254e-48da-8830-115bf085b872 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:10.839123 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9fac9c61-6add-4b1e-8b47-8219eb66d81d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:10.839123 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9fac9c61-6add-4b1e-8b47-8219eb66d81d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:10.847577 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-db64a9a4-254e-48da-8830-115bf085b872 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.229722 Dec 15 19:04:10.849570 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9fac9c61-6add-4b1e-8b47-8219eb66d81d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:10.854455 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9fac9c61-6add-4b1e-8b47-8219eb66d81d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:10.854455 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9fac9c61-6add-4b1e-8b47-8219eb66d81d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:10.854455 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9fac9c61-6add-4b1e-8b47-8219eb66d81d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:10.854696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 75/156] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:10 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:11.004287 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9fac9c61-6add-4b1e-8b47-8219eb66d81d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:11.012239 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9fac9c61-6add-4b1e-8b47-8219eb66d81d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.178029 Dec 15 19:04:11.012835 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 82/157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:10 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:11.204914 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c95dac97-e8f7-42a8-a887-28be9b2d0c68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:11.205538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c95dac97-e8f7-42a8-a887-28be9b2d0c68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:11.211485 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c95dac97-e8f7-42a8-a887-28be9b2d0c68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:11.213258 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c95dac97-e8f7-42a8-a887-28be9b2d0c68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:11.214097 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c95dac97-e8f7-42a8-a887-28be9b2d0c68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:11.214544 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c95dac97-e8f7-42a8-a887-28be9b2d0c68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:11.271494 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:11.272137 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:11.278070 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:11.278516 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:11.279356 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:11.279739 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:11.362628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c95dac97-e8f7-42a8-a887-28be9b2d0c68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:11.370882 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c95dac97-e8f7-42a8-a887-28be9b2d0c68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.170177 Dec 15 19:04:11.371451 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 76/158] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:11 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:11.433405 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:11.441067 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:11.442509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:11.443601 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f6cebac9-a0c3-42fb-8fa1-e32bee40d1ce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.175814 Dec 15 19:04:11.444406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 83/159] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:11 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:04:11.865340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a7d4252e-3238-48bd-bdb4-df6036550644 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:11.865942 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a7d4252e-3238-48bd-bdb4-df6036550644 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:11.871757 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a7d4252e-3238-48bd-bdb4-df6036550644 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:11.872195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a7d4252e-3238-48bd-bdb4-df6036550644 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:11.872957 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a7d4252e-3238-48bd-bdb4-df6036550644 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:11.873408 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a7d4252e-3238-48bd-bdb4-df6036550644 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:12.006659 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a7d4252e-3238-48bd-bdb4-df6036550644 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:12.014868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a7d4252e-3238-48bd-bdb4-df6036550644 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.153178 Dec 15 19:04:12.015444 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 77/160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:11 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:12.029506 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a388ac19-9400-44b0-89ce-651da55ea7c1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:12.030123 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a388ac19-9400-44b0-89ce-651da55ea7c1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:12.036545 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a388ac19-9400-44b0-89ce-651da55ea7c1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:12.037075 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a388ac19-9400-44b0-89ce-651da55ea7c1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:12.037897 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a388ac19-9400-44b0-89ce-651da55ea7c1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:12.038335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a388ac19-9400-44b0-89ce-651da55ea7c1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:12.169892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a388ac19-9400-44b0-89ce-651da55ea7c1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:12.181984 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a388ac19-9400-44b0-89ce-651da55ea7c1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.156196 Dec 15 19:04:12.188020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 84/161] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:12 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:12.388160 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e136d19f-2604-4030-989d-5bee480512cd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:12.388757 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e136d19f-2604-4030-989d-5bee480512cd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:12.395034 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e136d19f-2604-4030-989d-5bee480512cd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:12.395478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e136d19f-2604-4030-989d-5bee480512cd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:12.396336 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e136d19f-2604-4030-989d-5bee480512cd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:12.396793 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e136d19f-2604-4030-989d-5bee480512cd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:12.460483 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:12.461100 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:12.467859 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:12.468303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:12.469739 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:12.470208 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:12.534739 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e136d19f-2604-4030-989d-5bee480512cd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:12.541996 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e136d19f-2604-4030-989d-5bee480512cd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.157712 Dec 15 19:04:12.542565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 78/162] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:12 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:12.600087 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:12.607830 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:12.609438 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:12.610523 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-cca49d17-2b0d-468a-b981-18d7146f9bfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.153724 Dec 15 19:04:12.611074 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 85/163] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:12 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:04:13.031304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c029c136-4640-45ba-acda-f8cffb9508b7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:13.032726 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c029c136-4640-45ba-acda-f8cffb9508b7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:13.039587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c029c136-4640-45ba-acda-f8cffb9508b7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:13.040042 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c029c136-4640-45ba-acda-f8cffb9508b7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:13.045532 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c029c136-4640-45ba-acda-f8cffb9508b7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:13.046183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c029c136-4640-45ba-acda-f8cffb9508b7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:13.183674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c029c136-4640-45ba-acda-f8cffb9508b7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:13.191788 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c029c136-4640-45ba-acda-f8cffb9508b7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.164320 Dec 15 19:04:13.192301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 79/164] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:13 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:13.198868 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b4c108e6-e74f-4da9-8600-9511ef94c973 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:13.199480 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b4c108e6-e74f-4da9-8600-9511ef94c973 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:13.205499 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b4c108e6-e74f-4da9-8600-9511ef94c973 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:13.205949 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b4c108e6-e74f-4da9-8600-9511ef94c973 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:13.206737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b4c108e6-e74f-4da9-8600-9511ef94c973 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:13.207219 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b4c108e6-e74f-4da9-8600-9511ef94c973 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:13.346997 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b4c108e6-e74f-4da9-8600-9511ef94c973 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:13.354227 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b4c108e6-e74f-4da9-8600-9511ef94c973 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.159104 Dec 15 19:04:13.354786 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 86/165] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:13 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:13.558434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2faa7bf0-c082-48c8-b023-bab2e1f7b5f5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:13.559040 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2faa7bf0-c082-48c8-b023-bab2e1f7b5f5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:13.564974 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2faa7bf0-c082-48c8-b023-bab2e1f7b5f5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:13.565460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2faa7bf0-c082-48c8-b023-bab2e1f7b5f5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:13.566244 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2faa7bf0-c082-48c8-b023-bab2e1f7b5f5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:13.566680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2faa7bf0-c082-48c8-b023-bab2e1f7b5f5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:13.627703 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:13.628305 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:13.634739 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:13.635233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:13.636016 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:13.636623 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:13.751580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2faa7bf0-c082-48c8-b023-bab2e1f7b5f5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:13.760485 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2faa7bf0-c082-48c8-b023-bab2e1f7b5f5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.205555 Dec 15 19:04:13.761306 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 80/166] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:13 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:13.788164 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:13.795945 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:13.797497 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:13.798582 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-77920c3e-ad39-4b9c-a06e-977ce2631c63 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.174714 Dec 15 19:04:13.799139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 87/167] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:13 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:04:14.208330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d4c3719a-5652-409f-a900-30b6457467c0 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:14.208939 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d4c3719a-5652-409f-a900-30b6457467c0 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:14.214725 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d4c3719a-5652-409f-a900-30b6457467c0 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:14.215171 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d4c3719a-5652-409f-a900-30b6457467c0 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:14.215958 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d4c3719a-5652-409f-a900-30b6457467c0 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:14.216396 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d4c3719a-5652-409f-a900-30b6457467c0 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:14.353880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d4c3719a-5652-409f-a900-30b6457467c0 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:14.361251 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d4c3719a-5652-409f-a900-30b6457467c0 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.156778 Dec 15 19:04:14.361825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 81/168] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:14 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:14.371349 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e36f4df1-17ea-4410-a211-a41f411c432a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:14.371956 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e36f4df1-17ea-4410-a211-a41f411c432a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:14.378361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e36f4df1-17ea-4410-a211-a41f411c432a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:14.378804 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e36f4df1-17ea-4410-a211-a41f411c432a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:14.379580 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e36f4df1-17ea-4410-a211-a41f411c432a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:14.380011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e36f4df1-17ea-4410-a211-a41f411c432a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:14.514979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e36f4df1-17ea-4410-a211-a41f411c432a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:14.526537 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e36f4df1-17ea-4410-a211-a41f411c432a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.158722 Dec 15 19:04:14.527130 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 88/169] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:14 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:14.778047 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3616d802-d249-487e-8d27-9cda728e3050 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:14.778822 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3616d802-d249-487e-8d27-9cda728e3050 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:14.786265 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3616d802-d249-487e-8d27-9cda728e3050 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:14.786723 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3616d802-d249-487e-8d27-9cda728e3050 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:14.787959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3616d802-d249-487e-8d27-9cda728e3050 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:14.788598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3616d802-d249-487e-8d27-9cda728e3050 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:14.816162 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:14.816772 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:14.824169 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:14.824518 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:14.825353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:14.825936 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:14.958577 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:14.966135 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:14.967654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:14.968763 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5d7f3d76-5cd0-4446-8fc6-291a63b5f1fc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.156942 Dec 15 19:04:14.969552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 89/170] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:14 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:04:15.010622 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3616d802-d249-487e-8d27-9cda728e3050 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:15.018912 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3616d802-d249-487e-8d27-9cda728e3050 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.244632 Dec 15 19:04:15.019600 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 82/171] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:14 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:15.379263 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1e93e007-d094-4970-8555-3f1bed7324b4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:15.379873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1e93e007-d094-4970-8555-3f1bed7324b4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:15.385966 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e93e007-d094-4970-8555-3f1bed7324b4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:15.386407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e93e007-d094-4970-8555-3f1bed7324b4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:15.387226 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e93e007-d094-4970-8555-3f1bed7324b4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:15.387629 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e93e007-d094-4970-8555-3f1bed7324b4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:15.526533 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1e93e007-d094-4970-8555-3f1bed7324b4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:15.536227 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1e93e007-d094-4970-8555-3f1bed7324b4 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.160317 Dec 15 19:04:15.536227 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 90/172] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:15 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:15.543968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-92d3f4e8-8885-4425-a98c-0da338be0f0c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:15.544666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-92d3f4e8-8885-4425-a98c-0da338be0f0c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:15.551617 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-92d3f4e8-8885-4425-a98c-0da338be0f0c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:15.552262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-92d3f4e8-8885-4425-a98c-0da338be0f0c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:15.553035 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-92d3f4e8-8885-4425-a98c-0da338be0f0c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:15.553575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-92d3f4e8-8885-4425-a98c-0da338be0f0c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:15.695150 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-92d3f4e8-8885-4425-a98c-0da338be0f0c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:15.702521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-92d3f4e8-8885-4425-a98c-0da338be0f0c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.162142 Dec 15 19:04:15.703026 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 83/173] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:15 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:15.987512 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:15.988693 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:15.994536 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:15.995180 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:15.995966 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:15.996546 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:16.036225 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7817f45a-66d2-465e-8a43-7666e6127020 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:16.037524 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7817f45a-66d2-465e-8a43-7666e6127020 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:16.046620 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7817f45a-66d2-465e-8a43-7666e6127020 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:16.047176 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7817f45a-66d2-465e-8a43-7666e6127020 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:16.047995 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7817f45a-66d2-465e-8a43-7666e6127020 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:16.048592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7817f45a-66d2-465e-8a43-7666e6127020 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:16.150985 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:16.173347 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:16.175203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:16.178654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-69486aed-bafe-46ef-81e2-7c1f82178734 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.194328 Dec 15 19:04:16.179652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 91/174] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:15 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:16.230452 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7817f45a-66d2-465e-8a43-7666e6127020 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:16.238347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7817f45a-66d2-465e-8a43-7666e6127020 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.205741 Dec 15 19:04:16.239315 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 84/175] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:16 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:16.556466 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d4d0938c-26ee-4b67-950b-9f35254e5be7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:16.557090 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d4d0938c-26ee-4b67-950b-9f35254e5be7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:16.564743 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4d0938c-26ee-4b67-950b-9f35254e5be7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:16.565868 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4d0938c-26ee-4b67-950b-9f35254e5be7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:16.566912 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4d0938c-26ee-4b67-950b-9f35254e5be7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:16.567859 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4d0938c-26ee-4b67-950b-9f35254e5be7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:16.719991 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d4d0938c-26ee-4b67-950b-9f35254e5be7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:16.721169 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-08b91d8a-8a48-42aa-b89b-119bf7a637a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:16.722038 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-08b91d8a-8a48-42aa-b89b-119bf7a637a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:16.728375 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08b91d8a-8a48-42aa-b89b-119bf7a637a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:16.728652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d4d0938c-26ee-4b67-950b-9f35254e5be7 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.175648 Dec 15 19:04:16.729806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08b91d8a-8a48-42aa-b89b-119bf7a637a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:16.729806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08b91d8a-8a48-42aa-b89b-119bf7a637a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:16.729979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 92/176] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:16 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:16.730196 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08b91d8a-8a48-42aa-b89b-119bf7a637a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:16.883993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-08b91d8a-8a48-42aa-b89b-119bf7a637a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:16.893808 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-08b91d8a-8a48-42aa-b89b-119bf7a637a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.177939 Dec 15 19:04:16.903707 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 85/177] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:16 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:17.201653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:17.201653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:17.207978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:17.208403 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:17.209308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:17.209832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:17.255442 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-58e18192-82d5-4765-b509-7abb279627c7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:17.256176 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-58e18192-82d5-4765-b509-7abb279627c7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:17.263848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-58e18192-82d5-4765-b509-7abb279627c7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:17.264598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-58e18192-82d5-4765-b509-7abb279627c7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:17.266450 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-58e18192-82d5-4765-b509-7abb279627c7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:17.267212 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-58e18192-82d5-4765-b509-7abb279627c7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:17.388303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:17.397218 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:17.398962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:17.400039 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5a29aeab-cd39-4088-963d-0efe3e2bdc04 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.207637 Dec 15 19:04:17.400603 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 93/178] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:17 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:17.418624 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-58e18192-82d5-4765-b509-7abb279627c7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:17.426743 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-58e18192-82d5-4765-b509-7abb279627c7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.175202 Dec 15 19:04:17.433256 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 86/179] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:17 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:17.749178 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9c327a39-c506-405c-9bf1-e2cdd566a426 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:17.749788 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9c327a39-c506-405c-9bf1-e2cdd566a426 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:17.759682 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9c327a39-c506-405c-9bf1-e2cdd566a426 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:17.760346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9c327a39-c506-405c-9bf1-e2cdd566a426 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:17.761179 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9c327a39-c506-405c-9bf1-e2cdd566a426 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:17.761622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9c327a39-c506-405c-9bf1-e2cdd566a426 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:17.904654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9c327a39-c506-405c-9bf1-e2cdd566a426 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:17.912301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-19d12cbd-4f4b-49e1-9b1d-8554ce7693b9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:17.912840 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9c327a39-c506-405c-9bf1-e2cdd566a426 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.167483 Dec 15 19:04:17.912940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-19d12cbd-4f4b-49e1-9b1d-8554ce7693b9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:17.913138 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 94/180] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:17 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:17.918894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-19d12cbd-4f4b-49e1-9b1d-8554ce7693b9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:17.919342 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-19d12cbd-4f4b-49e1-9b1d-8554ce7693b9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:17.920112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-19d12cbd-4f4b-49e1-9b1d-8554ce7693b9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:17.920540 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-19d12cbd-4f4b-49e1-9b1d-8554ce7693b9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:18.049776 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-19d12cbd-4f4b-49e1-9b1d-8554ce7693b9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:18.057147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-19d12cbd-4f4b-49e1-9b1d-8554ce7693b9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.148648 Dec 15 19:04:18.057717 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 87/181] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:17 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:18.418211 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:18.418848 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:18.424625 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:18.425067 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:18.425863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:18.426284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:18.443312 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b6dfb322-91c1-472b-872b-44b0cac5dfde tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:18.443912 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b6dfb322-91c1-472b-872b-44b0cac5dfde tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:18.449833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b6dfb322-91c1-472b-872b-44b0cac5dfde tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:18.455664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b6dfb322-91c1-472b-872b-44b0cac5dfde tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:18.455664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b6dfb322-91c1-472b-872b-44b0cac5dfde tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:18.455664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b6dfb322-91c1-472b-872b-44b0cac5dfde tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:18.562309 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:18.570694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:18.572195 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:18.573323 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1e7f0638-a018-437c-88ca-81787f6c34f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.158783 Dec 15 19:04:18.573905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 95/182] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:18 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:18.579971 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b6dfb322-91c1-472b-872b-44b0cac5dfde tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:18.587309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b6dfb322-91c1-472b-872b-44b0cac5dfde tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.147632 Dec 15 19:04:18.587877 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 88/183] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:18 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:18.928653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2eade5ae-d355-4040-8d9c-68ec7f70f5e2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:18.929288 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2eade5ae-d355-4040-8d9c-68ec7f70f5e2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:18.934933 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2eade5ae-d355-4040-8d9c-68ec7f70f5e2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:18.935370 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2eade5ae-d355-4040-8d9c-68ec7f70f5e2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:18.936133 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2eade5ae-d355-4040-8d9c-68ec7f70f5e2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:18.936560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2eade5ae-d355-4040-8d9c-68ec7f70f5e2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:19.062380 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-2eade5ae-d355-4040-8d9c-68ec7f70f5e2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:19.070194 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2eade5ae-d355-4040-8d9c-68ec7f70f5e2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.145160 Dec 15 19:04:19.070763 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 96/184] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:18 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:19.074478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c5a82507-b323-44d2-8e2b-1f14a15def91 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:19.075185 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c5a82507-b323-44d2-8e2b-1f14a15def91 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:19.080962 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5a82507-b323-44d2-8e2b-1f14a15def91 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:19.081445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5a82507-b323-44d2-8e2b-1f14a15def91 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:19.082227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5a82507-b323-44d2-8e2b-1f14a15def91 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:19.082824 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5a82507-b323-44d2-8e2b-1f14a15def91 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:19.210715 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c5a82507-b323-44d2-8e2b-1f14a15def91 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:19.217941 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c5a82507-b323-44d2-8e2b-1f14a15def91 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.147383 Dec 15 19:04:19.218504 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 89/185] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:19 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:19.591935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:19.592450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:19.598732 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:19.599172 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:19.599939 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:19.600367 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:19.603696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0ff6552c-dc04-4f8b-bfd9-3b6eb388a689 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:19.604529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0ff6552c-dc04-4f8b-bfd9-3b6eb388a689 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:19.610921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0ff6552c-dc04-4f8b-bfd9-3b6eb388a689 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:19.615600 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0ff6552c-dc04-4f8b-bfd9-3b6eb388a689 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:19.615600 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0ff6552c-dc04-4f8b-bfd9-3b6eb388a689 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:19.615600 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0ff6552c-dc04-4f8b-bfd9-3b6eb388a689 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:19.736328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:19.744364 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:19.745914 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:19.747016 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ce4daed6-afc1-4c15-818b-78ee7ce49daa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.159042 Dec 15 19:04:19.747587 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 97/186] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:19 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:19.750707 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0ff6552c-dc04-4f8b-bfd9-3b6eb388a689 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:19.758018 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0ff6552c-dc04-4f8b-bfd9-3b6eb388a689 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.158111 Dec 15 19:04:19.758643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 90/187] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:19 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:20.086613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6ff6b323-0530-478b-9569-66ce34888f7b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:20.087255 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6ff6b323-0530-478b-9569-66ce34888f7b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:20.092996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ff6b323-0530-478b-9569-66ce34888f7b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:20.093482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ff6b323-0530-478b-9569-66ce34888f7b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:20.094523 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ff6b323-0530-478b-9569-66ce34888f7b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:20.095123 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ff6b323-0530-478b-9569-66ce34888f7b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:20.224748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6ff6b323-0530-478b-9569-66ce34888f7b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:20.232200 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6ff6b323-0530-478b-9569-66ce34888f7b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.149273 Dec 15 19:04:20.235527 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 98/188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:20 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:20.235641 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ac4e1804-4bdb-4762-a47b-e35804c43b05 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:20.235641 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ac4e1804-4bdb-4762-a47b-e35804c43b05 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:20.240566 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac4e1804-4bdb-4762-a47b-e35804c43b05 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:20.241171 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac4e1804-4bdb-4762-a47b-e35804c43b05 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:20.242027 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac4e1804-4bdb-4762-a47b-e35804c43b05 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:20.242460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac4e1804-4bdb-4762-a47b-e35804c43b05 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:20.382778 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ac4e1804-4bdb-4762-a47b-e35804c43b05 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:20.390322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ac4e1804-4bdb-4762-a47b-e35804c43b05 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.159987 Dec 15 19:04:20.391464 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 91/189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:20 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:20.765974 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:20.766589 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:20.772592 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:20.773042 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:20.773857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:20.774333 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:20.775237 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4da29352-0b14-4f7b-ad9c-a13f38542933 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:20.775835 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4da29352-0b14-4f7b-ad9c-a13f38542933 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:20.782140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4da29352-0b14-4f7b-ad9c-a13f38542933 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:20.782590 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4da29352-0b14-4f7b-ad9c-a13f38542933 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:20.783357 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4da29352-0b14-4f7b-ad9c-a13f38542933 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:20.783791 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4da29352-0b14-4f7b-ad9c-a13f38542933 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:20.902314 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:20.909951 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:20.911457 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:20.912551 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f3c4eace-2e9d-4baf-8a3a-1fce2a1a2a25 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.150814 Dec 15 19:04:20.913129 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 99/190] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:20 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:20.914238 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4da29352-0b14-4f7b-ad9c-a13f38542933 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:20.921627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4da29352-0b14-4f7b-ad9c-a13f38542933 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.149967 Dec 15 19:04:20.922251 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 92/191] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:20 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:21.248726 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c31f68d6-7974-40ae-9035-c4691344d1d2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:21.249360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c31f68d6-7974-40ae-9035-c4691344d1d2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:21.255936 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c31f68d6-7974-40ae-9035-c4691344d1d2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:21.256383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c31f68d6-7974-40ae-9035-c4691344d1d2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:21.257201 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c31f68d6-7974-40ae-9035-c4691344d1d2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:21.257638 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c31f68d6-7974-40ae-9035-c4691344d1d2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:21.385862 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c31f68d6-7974-40ae-9035-c4691344d1d2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:21.392939 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c31f68d6-7974-40ae-9035-c4691344d1d2 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.147843 Dec 15 19:04:21.393527 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 100/192] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:21 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:21.407502 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7bddc67b-497c-480a-910b-ef5bd2a0472c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:21.408136 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7bddc67b-497c-480a-910b-ef5bd2a0472c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:21.413880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7bddc67b-497c-480a-910b-ef5bd2a0472c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:21.414328 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7bddc67b-497c-480a-910b-ef5bd2a0472c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:21.415098 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7bddc67b-497c-480a-910b-ef5bd2a0472c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:21.415530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7bddc67b-497c-480a-910b-ef5bd2a0472c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:21.543284 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7bddc67b-497c-480a-910b-ef5bd2a0472c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:21.551081 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7bddc67b-497c-480a-910b-ef5bd2a0472c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.147340 Dec 15 19:04:21.551638 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 93/193] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:21 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:21.930084 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:21.930677 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:21.936527 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:21.936967 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:21.938348 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:21.938777 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:21.939599 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-652911c8-a3d7-470b-8b75-780f48bdc3c9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:21.940323 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-652911c8-a3d7-470b-8b75-780f48bdc3c9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:21.946502 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-652911c8-a3d7-470b-8b75-780f48bdc3c9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:21.946959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-652911c8-a3d7-470b-8b75-780f48bdc3c9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:21.947747 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-652911c8-a3d7-470b-8b75-780f48bdc3c9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:21.948182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-652911c8-a3d7-470b-8b75-780f48bdc3c9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:22.066438 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:22.074306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:22.075817 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:22.076946 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8787ec3f-4483-4fe9-8cfc-b8b7264d477a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.150533 Dec 15 19:04:22.077759 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 101/194] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:21 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:04:22.078791 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-652911c8-a3d7-470b-8b75-780f48bdc3c9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:22.085949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-652911c8-a3d7-470b-8b75-780f48bdc3c9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.151627 Dec 15 19:04:22.086512 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 94/195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:21 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:22.409531 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c0ce272f-3b3a-4d36-97ca-bcf680a71a85 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:22.410132 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c0ce272f-3b3a-4d36-97ca-bcf680a71a85 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:22.415906 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0ce272f-3b3a-4d36-97ca-bcf680a71a85 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:22.416352 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0ce272f-3b3a-4d36-97ca-bcf680a71a85 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:22.417155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0ce272f-3b3a-4d36-97ca-bcf680a71a85 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:22.417592 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0ce272f-3b3a-4d36-97ca-bcf680a71a85 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:22.555654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c0ce272f-3b3a-4d36-97ca-bcf680a71a85 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:22.563684 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c0ce272f-3b3a-4d36-97ca-bcf680a71a85 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.158150 Dec 15 19:04:22.564436 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 102/196] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:22 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:22.568138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d8ccea5e-17dd-4be9-96d4-7f21536fd07b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:22.573434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d8ccea5e-17dd-4be9-96d4-7f21536fd07b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:22.575676 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d8ccea5e-17dd-4be9-96d4-7f21536fd07b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:22.576153 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d8ccea5e-17dd-4be9-96d4-7f21536fd07b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:22.576941 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d8ccea5e-17dd-4be9-96d4-7f21536fd07b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:22.577410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d8ccea5e-17dd-4be9-96d4-7f21536fd07b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:22.705513 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d8ccea5e-17dd-4be9-96d4-7f21536fd07b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:22.712744 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d8ccea5e-17dd-4be9-96d4-7f21536fd07b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.148824 Dec 15 19:04:22.713346 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 95/197] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:22 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:23.094406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:23.095002 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:23.100827 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:23.101307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:23.105223 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:23.105223 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:23.105476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-457e85ec-186d-49ce-9bfd-1da3a5521a14 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:23.105476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-457e85ec-186d-49ce-9bfd-1da3a5521a14 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:23.108989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-457e85ec-186d-49ce-9bfd-1da3a5521a14 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:23.109463 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-457e85ec-186d-49ce-9bfd-1da3a5521a14 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:23.110246 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-457e85ec-186d-49ce-9bfd-1da3a5521a14 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:23.110685 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-457e85ec-186d-49ce-9bfd-1da3a5521a14 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:23.245623 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:23.254010 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:23.255563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:23.256662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f531667d-beab-4fdc-a776-802a78325d5b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.166003 Dec 15 19:04:23.257250 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 103/198] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:23 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:23.259706 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-457e85ec-186d-49ce-9bfd-1da3a5521a14 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:23.271007 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-457e85ec-186d-49ce-9bfd-1da3a5521a14 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.172041 Dec 15 19:04:23.271573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 96/199] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:23 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:23.589296 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-78ceb890-364a-4d64-95e2-bd39e2d7e3be tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:23.590349 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-78ceb890-364a-4d64-95e2-bd39e2d7e3be tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:23.601892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78ceb890-364a-4d64-95e2-bd39e2d7e3be tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:23.602419 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78ceb890-364a-4d64-95e2-bd39e2d7e3be tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:23.603315 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78ceb890-364a-4d64-95e2-bd39e2d7e3be tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:23.603891 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78ceb890-364a-4d64-95e2-bd39e2d7e3be tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:23.731653 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-08eaf422-966b-4fe5-9fbb-c1730c581379 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:23.732264 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-08eaf422-966b-4fe5-9fbb-c1730c581379 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:23.739320 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08eaf422-966b-4fe5-9fbb-c1730c581379 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:23.739774 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08eaf422-966b-4fe5-9fbb-c1730c581379 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:23.740569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08eaf422-966b-4fe5-9fbb-c1730c581379 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:23.741006 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-08eaf422-966b-4fe5-9fbb-c1730c581379 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:23.757717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-78ceb890-364a-4d64-95e2-bd39e2d7e3be tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:23.766264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-78ceb890-364a-4d64-95e2-bd39e2d7e3be tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.181025 Dec 15 19:04:23.775453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 104/200] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:23 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:23.888615 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-08eaf422-966b-4fe5-9fbb-c1730c581379 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:23.896093 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-08eaf422-966b-4fe5-9fbb-c1730c581379 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.168223 Dec 15 19:04:23.896652 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 97/201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:23 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:24.277456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:24.278066 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:24.284526 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:24.286227 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:24.286227 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:24.286227 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:24.291431 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8e4fbc1a-9e10-495a-8329-3a62b17160ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:24.292033 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8e4fbc1a-9e10-495a-8329-3a62b17160ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:24.297821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8e4fbc1a-9e10-495a-8329-3a62b17160ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:24.298274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8e4fbc1a-9e10-495a-8329-3a62b17160ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:24.299051 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8e4fbc1a-9e10-495a-8329-3a62b17160ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:24.299499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8e4fbc1a-9e10-495a-8329-3a62b17160ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:24.416897 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:24.425228 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:24.426670 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:24.427772 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bbfb64d2-f4ba-4314-812a-d7070178e5c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.153983 Dec 15 19:04:24.428352 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 105/202] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:24 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:24.433325 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8e4fbc1a-9e10-495a-8329-3a62b17160ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:24.441112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8e4fbc1a-9e10-495a-8329-3a62b17160ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.153255 Dec 15 19:04:24.441746 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 98/203] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:24 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:24.782487 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e7da7d5f-736f-4802-81cd-ec458ccae6c8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:24.783092 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e7da7d5f-736f-4802-81cd-ec458ccae6c8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:24.788799 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7da7d5f-736f-4802-81cd-ec458ccae6c8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:24.789304 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7da7d5f-736f-4802-81cd-ec458ccae6c8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:24.790276 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7da7d5f-736f-4802-81cd-ec458ccae6c8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:24.790712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7da7d5f-736f-4802-81cd-ec458ccae6c8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:24.913289 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b7059a1f-221e-4271-9fbb-98e5b288c3a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:24.914461 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b7059a1f-221e-4271-9fbb-98e5b288c3a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:24.921074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7059a1f-221e-4271-9fbb-98e5b288c3a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:24.922313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7059a1f-221e-4271-9fbb-98e5b288c3a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:24.923348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7059a1f-221e-4271-9fbb-98e5b288c3a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:24.923984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7059a1f-221e-4271-9fbb-98e5b288c3a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:24.934018 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e7da7d5f-736f-4802-81cd-ec458ccae6c8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:24.943701 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e7da7d5f-736f-4802-81cd-ec458ccae6c8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.164654 Dec 15 19:04:24.944573 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 106/204] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:24 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:25.069551 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b7059a1f-221e-4271-9fbb-98e5b288c3a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:25.076715 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b7059a1f-221e-4271-9fbb-98e5b288c3a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.167584 Dec 15 19:04:25.077318 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 99/205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:24 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:25.445342 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:25.445949 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:25.451886 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:25.452346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:25.453163 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:25.453606 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:25.459533 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bd99e4ce-502a-4882-b83c-9e7a0b59e86f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:25.460704 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bd99e4ce-502a-4882-b83c-9e7a0b59e86f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:25.466381 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bd99e4ce-502a-4882-b83c-9e7a0b59e86f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:25.466831 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bd99e4ce-502a-4882-b83c-9e7a0b59e86f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:25.467789 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bd99e4ce-502a-4882-b83c-9e7a0b59e86f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:25.468430 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bd99e4ce-502a-4882-b83c-9e7a0b59e86f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:25.596223 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:25.604282 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:25.605879 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:25.606980 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d3b32e57-146a-4042-8aa3-545f40c0282b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.165279 Dec 15 19:04:25.607719 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 107/206] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:25 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:25.624019 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bd99e4ce-502a-4882-b83c-9e7a0b59e86f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:25.631860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bd99e4ce-502a-4882-b83c-9e7a0b59e86f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.176030 Dec 15 19:04:25.632452 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 100/207] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:25 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:25.814073 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-2330cf3d-309d-4d16-9d5a-6bef9ecabf5f req-537f4eec-5ca5-4b69-905f-d1269509cd6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0314d560-94f2-4a77-a4ba-e572c16baf83", "name": "network-vif-plugged", "status": "completed", "tag": "a45ea0ec-0077-419a-b2e9-6b0cc9fbca81"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:25.815656 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:04:25.815656 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:04:25.822740 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-2330cf3d-309d-4d16-9d5a-6bef9ecabf5f req-537f4eec-5ca5-4b69-905f-d1269509cd6e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:25.823178 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-2330cf3d-309d-4d16-9d5a-6bef9ecabf5f req-537f4eec-5ca5-4b69-905f-d1269509cd6e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:25.834971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-2330cf3d-309d-4d16-9d5a-6bef9ecabf5f req-537f4eec-5ca5-4b69-905f-d1269509cd6e service nova] Creating event network-vif-plugged:a45ea0ec-0077-419a-b2e9-6b0cc9fbca81 for instance 0314d560-94f2-4a77-a4ba-e572c16baf83 on hv-cinder-81268 Dec 15 19:04:25.840444 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-2330cf3d-309d-4d16-9d5a-6bef9ecabf5f req-537f4eec-5ca5-4b69-905f-d1269509cd6e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085948 Dec 15 19:04:25.841354 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 108/208] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:04:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:04:25.960026 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-cfa51530-c562-4f5e-963c-c67e8d399608 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:25.961198 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-cfa51530-c562-4f5e-963c-c67e8d399608 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:25.966972 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cfa51530-c562-4f5e-963c-c67e8d399608 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:25.967423 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cfa51530-c562-4f5e-963c-c67e8d399608 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:25.968217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cfa51530-c562-4f5e-963c-c67e8d399608 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:25.968693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cfa51530-c562-4f5e-963c-c67e8d399608 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:26.094184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3d46c4de-b954-4dd8-8cb8-59f6b0f90618 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:26.094889 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3d46c4de-b954-4dd8-8cb8-59f6b0f90618 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:26.100941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d46c4de-b954-4dd8-8cb8-59f6b0f90618 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:26.101440 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d46c4de-b954-4dd8-8cb8-59f6b0f90618 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:26.106249 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d46c4de-b954-4dd8-8cb8-59f6b0f90618 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:26.106249 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d46c4de-b954-4dd8-8cb8-59f6b0f90618 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:26.106448 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-cfa51530-c562-4f5e-963c-c67e8d399608 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:26.111501 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-cfa51530-c562-4f5e-963c-c67e8d399608 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.155268 Dec 15 19:04:26.112075 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 101/209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:25 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:26.232598 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3d46c4de-b954-4dd8-8cb8-59f6b0f90618 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:26.239801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3d46c4de-b954-4dd8-8cb8-59f6b0f90618 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.149564 Dec 15 19:04:26.240362 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 109/210] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:26 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:26.626097 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:26.626707 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:26.632613 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:26.633070 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:26.633894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:26.634581 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:26.648822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2a95765f-b06e-463b-9c38-4b826904f096 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:26.649450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2a95765f-b06e-463b-9c38-4b826904f096 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:26.655120 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2a95765f-b06e-463b-9c38-4b826904f096 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:26.655561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2a95765f-b06e-463b-9c38-4b826904f096 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:26.656331 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2a95765f-b06e-463b-9c38-4b826904f096 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:26.656757 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2a95765f-b06e-463b-9c38-4b826904f096 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:26.771690 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:26.780197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:26.782626 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:26.783988 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-42b4f8fe-b938-4a15-a7f4-9e599f495294 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.162252 Dec 15 19:04:26.784760 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 102/211] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:26 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:26.816969 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-2a95765f-b06e-463b-9c38-4b826904f096 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:26.824256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2a95765f-b06e-463b-9c38-4b826904f096 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.179041 Dec 15 19:04:26.824825 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 110/212] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:26 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:27.127344 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7b72357f-d6ea-42c8-9f1a-47ab8d254c75 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:27.127955 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7b72357f-d6ea-42c8-9f1a-47ab8d254c75 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:27.135080 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7b72357f-d6ea-42c8-9f1a-47ab8d254c75 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:27.135535 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7b72357f-d6ea-42c8-9f1a-47ab8d254c75 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:27.136524 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7b72357f-d6ea-42c8-9f1a-47ab8d254c75 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:27.136963 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7b72357f-d6ea-42c8-9f1a-47ab8d254c75 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:27.258070 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bbd82d56-0518-4847-b4e1-60f4269cf28d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:27.258681 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bbd82d56-0518-4847-b4e1-60f4269cf28d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:27.264978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bbd82d56-0518-4847-b4e1-60f4269cf28d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:27.265995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bbd82d56-0518-4847-b4e1-60f4269cf28d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:27.266789 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bbd82d56-0518-4847-b4e1-60f4269cf28d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:27.267220 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bbd82d56-0518-4847-b4e1-60f4269cf28d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:27.279733 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7b72357f-d6ea-42c8-9f1a-47ab8d254c75 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:27.287658 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7b72357f-d6ea-42c8-9f1a-47ab8d254c75 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.163916 Dec 15 19:04:27.288322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 103/213] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:27 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:27.396013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bbd82d56-0518-4847-b4e1-60f4269cf28d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:27.403186 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bbd82d56-0518-4847-b4e1-60f4269cf28d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.148911 Dec 15 19:04:27.403754 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 111/214] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:27 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:27.801808 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:27.802409 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:27.808225 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:27.808662 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:27.809465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:27.809897 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:27.840841 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2d393f06-e875-466d-9571-04edbd2c2925 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:27.841474 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2d393f06-e875-466d-9571-04edbd2c2925 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:27.847456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2d393f06-e875-466d-9571-04edbd2c2925 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:27.847905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2d393f06-e875-466d-9571-04edbd2c2925 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:27.848698 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2d393f06-e875-466d-9571-04edbd2c2925 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:27.849155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2d393f06-e875-466d-9571-04edbd2c2925 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:27.940073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:27.947895 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:27.949421 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:27.950508 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ac6823af-a661-4f3b-a58a-ed4560f0d237 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.152400 Dec 15 19:04:27.951067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 104/215] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:27 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:27.955326 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-c9957cd9-3c28-4895-8275-a4bccfbb9ab5 req-ea621754-dd02-4289-a009-1413b041d807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a4a770-fe68-4180-b052-5b7161dd2293", "name": "network-vif-plugged", "status": "completed", "tag": "891fcb6e-7400-455c-824c-1bcd8f750785"}, {"server_uuid": "93f130e2-e041-400a-934f-9c837ba505ef", "name": "network-vif-plugged", "status": "completed", "tag": "314bc344-bc90-4467-84d5-ab3c08f0f363"}, {"server_uuid": "0f02ea25-0aca-4414-a953-d09699b8d014", "name": "network-vif-plugged", "status": "completed", "tag": "98ba3766-39b5-4cc8-b78b-7acb892ea611"}, {"server_uuid": "93490542-6e11-41c3-9901-c06a1dd65cef", "name": "network-vif-plugged", "status": "completed", "tag": "2c56f2d3-88c3-4e37-b62b-41f5e58fee33"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:27.957260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:04:27.957260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:04:27.965472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-c9957cd9-3c28-4895-8275-a4bccfbb9ab5 req-ea621754-dd02-4289-a009-1413b041d807 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:27.965905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-c9957cd9-3c28-4895-8275-a4bccfbb9ab5 req-ea621754-dd02-4289-a009-1413b041d807 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:27.977150 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-2d393f06-e875-466d-9571-04edbd2c2925 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:27.980574 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-c9957cd9-3c28-4895-8275-a4bccfbb9ab5 req-ea621754-dd02-4289-a009-1413b041d807 service nova] Creating event network-vif-plugged:891fcb6e-7400-455c-824c-1bcd8f750785 for instance 11a4a770-fe68-4180-b052-5b7161dd2293 on hv-cinder-81268 Dec 15 19:04:27.981074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-c9957cd9-3c28-4895-8275-a4bccfbb9ab5 req-ea621754-dd02-4289-a009-1413b041d807 service nova] Creating event network-vif-plugged:314bc344-bc90-4467-84d5-ab3c08f0f363 for instance 93f130e2-e041-400a-934f-9c837ba505ef on hv-cinder-81268 Dec 15 19:04:27.981621 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-c9957cd9-3c28-4895-8275-a4bccfbb9ab5 req-ea621754-dd02-4289-a009-1413b041d807 service nova] Creating event network-vif-plugged:98ba3766-39b5-4cc8-b78b-7acb892ea611 for instance 0f02ea25-0aca-4414-a953-d09699b8d014 on hv-cinder-81268 Dec 15 19:04:27.982111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-c9957cd9-3c28-4895-8275-a4bccfbb9ab5 req-ea621754-dd02-4289-a009-1413b041d807 service nova] Creating event network-vif-plugged:2c56f2d3-88c3-4e37-b62b-41f5e58fee33 for instance 93490542-6e11-41c3-9901-c06a1dd65cef on hv-cinder-81268 Dec 15 19:04:27.985283 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2d393f06-e875-466d-9571-04edbd2c2925 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.148049 Dec 15 19:04:27.985930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 112/216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:27 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:27.991878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-c9957cd9-3c28-4895-8275-a4bccfbb9ab5 req-ea621754-dd02-4289-a009-1413b041d807 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.039661 Dec 15 19:04:27.992405 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 105/217] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:04:27 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:04:28.305295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9eb4bb64-7009-4072-808b-2e4d54f2f90b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:28.305895 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9eb4bb64-7009-4072-808b-2e4d54f2f90b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:28.311634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9eb4bb64-7009-4072-808b-2e4d54f2f90b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:28.312080 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9eb4bb64-7009-4072-808b-2e4d54f2f90b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:28.312865 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9eb4bb64-7009-4072-808b-2e4d54f2f90b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:28.313314 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9eb4bb64-7009-4072-808b-2e4d54f2f90b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:28.419926 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-50aba81e-02c5-46e0-af70-dc18cdc4703c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:28.420628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-50aba81e-02c5-46e0-af70-dc18cdc4703c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:28.427309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-50aba81e-02c5-46e0-af70-dc18cdc4703c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:28.427759 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-50aba81e-02c5-46e0-af70-dc18cdc4703c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:28.428578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-50aba81e-02c5-46e0-af70-dc18cdc4703c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:28.429013 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-50aba81e-02c5-46e0-af70-dc18cdc4703c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:28.446016 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9eb4bb64-7009-4072-808b-2e4d54f2f90b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:28.453748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9eb4bb64-7009-4072-808b-2e4d54f2f90b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.152141 Dec 15 19:04:28.454514 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 113/218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:28 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:28.560333 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-50aba81e-02c5-46e0-af70-dc18cdc4703c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:28.567767 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-50aba81e-02c5-46e0-af70-dc18cdc4703c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.151745 Dec 15 19:04:28.573021 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 106/219] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:28 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:28.968038 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:28.969277 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:28.975090 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:28.975533 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:28.976293 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:28.976716 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:29.002260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-80f61009-186a-405c-97e0-d03f53cceeab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:29.002859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-80f61009-186a-405c-97e0-d03f53cceeab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:29.008816 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-80f61009-186a-405c-97e0-d03f53cceeab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:29.009562 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-80f61009-186a-405c-97e0-d03f53cceeab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:29.010343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-80f61009-186a-405c-97e0-d03f53cceeab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:29.010772 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-80f61009-186a-405c-97e0-d03f53cceeab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:29.103202 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:29.110864 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:29.112539 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:29.113646 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8b5769f9-cbfd-47fe-a0cf-868f1b8401af tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.149228 Dec 15 19:04:29.114200 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 114/220] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:28 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:29.143370 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-80f61009-186a-405c-97e0-d03f53cceeab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:29.150751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-80f61009-186a-405c-97e0-d03f53cceeab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.152600 Dec 15 19:04:29.151329 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 107/221] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:28 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:29.470583 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d259895c-3650-4800-b4ec-2f9de34003cd tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:29.471172 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d259895c-3650-4800-b4ec-2f9de34003cd tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:29.478951 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d259895c-3650-4800-b4ec-2f9de34003cd tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:29.479413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d259895c-3650-4800-b4ec-2f9de34003cd tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:29.480422 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d259895c-3650-4800-b4ec-2f9de34003cd tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:29.480875 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d259895c-3650-4800-b4ec-2f9de34003cd tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:29.589157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a2a4a75c-2aea-4f8a-9b27-0565f88ba05d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:29.590545 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a2a4a75c-2aea-4f8a-9b27-0565f88ba05d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:29.603510 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a2a4a75c-2aea-4f8a-9b27-0565f88ba05d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:29.606617 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a2a4a75c-2aea-4f8a-9b27-0565f88ba05d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:29.608329 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a2a4a75c-2aea-4f8a-9b27-0565f88ba05d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:29.608867 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a2a4a75c-2aea-4f8a-9b27-0565f88ba05d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:29.742707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d259895c-3650-4800-b4ec-2f9de34003cd tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:29.752223 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d259895c-3650-4800-b4ec-2f9de34003cd tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.285157 Dec 15 19:04:29.752874 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 115/222] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:29 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:29.975944 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a2a4a75c-2aea-4f8a-9b27-0565f88ba05d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:29.983440 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a2a4a75c-2aea-4f8a-9b27-0565f88ba05d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.402300 Dec 15 19:04:29.984063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 108/223] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:29 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:30.130669 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:30.131279 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:30.137466 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:30.137926 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:30.138804 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:30.139243 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:30.167347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-cd78423f-9683-40f1-bdbf-b1521106264a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:30.167940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-cd78423f-9683-40f1-bdbf-b1521106264a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:30.174162 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cd78423f-9683-40f1-bdbf-b1521106264a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:30.174637 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cd78423f-9683-40f1-bdbf-b1521106264a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:30.175418 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cd78423f-9683-40f1-bdbf-b1521106264a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:30.175842 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cd78423f-9683-40f1-bdbf-b1521106264a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:30.273530 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:30.282869 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:30.284509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:30.285730 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a1ce2297-2f5d-4854-bcc0-424405e50ff8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.158823 Dec 15 19:04:30.286533 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 116/224] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:30 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:30.310476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-cd78423f-9683-40f1-bdbf-b1521106264a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:30.317670 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-cd78423f-9683-40f1-bdbf-b1521106264a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.153949 Dec 15 19:04:30.318235 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 109/225] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:30 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:30.769872 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-66882f87-bac9-4870-915f-6e728a128dce tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:30.770528 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-66882f87-bac9-4870-915f-6e728a128dce tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:30.776138 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66882f87-bac9-4870-915f-6e728a128dce tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:30.776586 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66882f87-bac9-4870-915f-6e728a128dce tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:30.777386 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66882f87-bac9-4870-915f-6e728a128dce tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:30.777820 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66882f87-bac9-4870-915f-6e728a128dce tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:30.908958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-66882f87-bac9-4870-915f-6e728a128dce tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:30.916908 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-66882f87-bac9-4870-915f-6e728a128dce tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.151196 Dec 15 19:04:30.917516 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 117/226] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:30 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:31.001755 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c4e7f526-ee85-4e89-b279-82afb67c3eac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:31.002360 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c4e7f526-ee85-4e89-b279-82afb67c3eac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:31.008107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4e7f526-ee85-4e89-b279-82afb67c3eac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:31.008572 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4e7f526-ee85-4e89-b279-82afb67c3eac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:31.017182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4e7f526-ee85-4e89-b279-82afb67c3eac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:31.017182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4e7f526-ee85-4e89-b279-82afb67c3eac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:31.146719 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c4e7f526-ee85-4e89-b279-82afb67c3eac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:31.155741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c4e7f526-ee85-4e89-b279-82afb67c3eac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.158287 Dec 15 19:04:31.156347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 110/227] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:30 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:31.303834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:31.304374 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:31.310243 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:31.310690 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:31.311467 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:31.311901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:31.334497 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ca80a1d1-27a4-4477-a629-19e5eca3b9f4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:31.335116 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ca80a1d1-27a4-4477-a629-19e5eca3b9f4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:31.342816 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ca80a1d1-27a4-4477-a629-19e5eca3b9f4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:31.343265 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ca80a1d1-27a4-4477-a629-19e5eca3b9f4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:31.345756 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ca80a1d1-27a4-4477-a629-19e5eca3b9f4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:31.346226 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ca80a1d1-27a4-4477-a629-19e5eca3b9f4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:31.448319 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:31.456090 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:31.457628 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:31.458836 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ccccb1e0-66df-45ff-81f5-6050cff4a20f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.159052 Dec 15 19:04:31.459406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 118/228] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:31 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:31.481910 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ca80a1d1-27a4-4477-a629-19e5eca3b9f4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:31.489812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ca80a1d1-27a4-4477-a629-19e5eca3b9f4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.159264 Dec 15 19:04:31.490373 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 111/229] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:31 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:31.946763 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-87859bfe-ddc7-41df-8e90-40113c45242f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:31.948824 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-87859bfe-ddc7-41df-8e90-40113c45242f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:31.965628 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87859bfe-ddc7-41df-8e90-40113c45242f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:31.966078 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87859bfe-ddc7-41df-8e90-40113c45242f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:31.966869 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87859bfe-ddc7-41df-8e90-40113c45242f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:31.967311 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87859bfe-ddc7-41df-8e90-40113c45242f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:32.147790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-87859bfe-ddc7-41df-8e90-40113c45242f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:32.155294 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-87859bfe-ddc7-41df-8e90-40113c45242f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.223980 Dec 15 19:04:32.155942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 119/230] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:31 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:32.174166 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ab3aaa0d-0c07-482c-b25a-f91e3f4a89f0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:32.174880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ab3aaa0d-0c07-482c-b25a-f91e3f4a89f0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:32.185940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ab3aaa0d-0c07-482c-b25a-f91e3f4a89f0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:32.185940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ab3aaa0d-0c07-482c-b25a-f91e3f4a89f0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:32.185940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ab3aaa0d-0c07-482c-b25a-f91e3f4a89f0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:32.185940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ab3aaa0d-0c07-482c-b25a-f91e3f4a89f0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:32.364880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ab3aaa0d-0c07-482c-b25a-f91e3f4a89f0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:32.372238 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ab3aaa0d-0c07-482c-b25a-f91e3f4a89f0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1318 microversion: 2.1 time: 0.201705 Dec 15 19:04:32.373124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 112/231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:32 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:32.476718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:32.478723 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:32.483270 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:32.483893 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:32.484982 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:32.485447 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:32.507695 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ba84dd59-c5f5-4267-96fd-51fdfaa78bbf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:32.508465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ba84dd59-c5f5-4267-96fd-51fdfaa78bbf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:32.515267 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ba84dd59-c5f5-4267-96fd-51fdfaa78bbf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:32.515721 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ba84dd59-c5f5-4267-96fd-51fdfaa78bbf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:32.516509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ba84dd59-c5f5-4267-96fd-51fdfaa78bbf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:32.516945 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ba84dd59-c5f5-4267-96fd-51fdfaa78bbf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:32.640982 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:32.649036 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:32.650811 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:32.652301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-92f7fe14-f257-4cea-bda2-1994826da122 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.179284 Dec 15 19:04:32.653371 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 120/232] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:32 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:32.690256 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ba84dd59-c5f5-4267-96fd-51fdfaa78bbf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:32.697357 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ba84dd59-c5f5-4267-96fd-51fdfaa78bbf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.194285 Dec 15 19:04:32.697947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 113/233] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:32 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:33.171715 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8e562845-36da-4aed-a2b6-4555f528ac72 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:33.172350 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8e562845-36da-4aed-a2b6-4555f528ac72 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:33.178168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8e562845-36da-4aed-a2b6-4555f528ac72 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:33.178612 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8e562845-36da-4aed-a2b6-4555f528ac72 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:33.179411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8e562845-36da-4aed-a2b6-4555f528ac72 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:33.179820 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8e562845-36da-4aed-a2b6-4555f528ac72 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:33.316505 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8e562845-36da-4aed-a2b6-4555f528ac72 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:33.327082 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8e562845-36da-4aed-a2b6-4555f528ac72 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.158950 Dec 15 19:04:33.328176 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 121/234] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:33 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:33.394276 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fb02ef47-0fe9-47a2-b00b-b9eddf4dcabd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:33.394983 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fb02ef47-0fe9-47a2-b00b-b9eddf4dcabd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:33.400775 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb02ef47-0fe9-47a2-b00b-b9eddf4dcabd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:33.401255 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb02ef47-0fe9-47a2-b00b-b9eddf4dcabd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:33.402027 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb02ef47-0fe9-47a2-b00b-b9eddf4dcabd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:33.402456 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb02ef47-0fe9-47a2-b00b-b9eddf4dcabd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:33.536373 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fb02ef47-0fe9-47a2-b00b-b9eddf4dcabd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:33.543922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fb02ef47-0fe9-47a2-b00b-b9eddf4dcabd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1509 microversion: 2.1 time: 0.153787 Dec 15 19:04:33.544481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 114/235] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:33 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:33.671652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:33.672726 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:33.678522 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:33.679049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:33.679904 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:33.680437 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:33.715107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-12a20fde-c235-468c-a237-66774f83e763 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:33.715813 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-12a20fde-c235-468c-a237-66774f83e763 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:33.721804 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-12a20fde-c235-468c-a237-66774f83e763 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:33.722509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-12a20fde-c235-468c-a237-66774f83e763 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:33.729751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-12a20fde-c235-468c-a237-66774f83e763 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:33.729751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-12a20fde-c235-468c-a237-66774f83e763 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:33.839293 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:33.864873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:33.864873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:33.865987 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ee4fbbe4-4c93-4894-ba33-a925954d13cd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.198706 Dec 15 19:04:33.866707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 122/236] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:33 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:33.880862 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-12a20fde-c235-468c-a237-66774f83e763 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:33.888429 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-12a20fde-c235-468c-a237-66774f83e763 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.177311 Dec 15 19:04:33.888998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 115/237] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:33 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:34.347913 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ca5b304e-3d1e-4719-b4c0-be10960ae9c9 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:34.348563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ca5b304e-3d1e-4719-b4c0-be10960ae9c9 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:34.355813 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ca5b304e-3d1e-4719-b4c0-be10960ae9c9 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:34.356347 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ca5b304e-3d1e-4719-b4c0-be10960ae9c9 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:34.360820 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ca5b304e-3d1e-4719-b4c0-be10960ae9c9 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:34.360820 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ca5b304e-3d1e-4719-b4c0-be10960ae9c9 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:34.494176 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ca5b304e-3d1e-4719-b4c0-be10960ae9c9 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:34.501445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ca5b304e-3d1e-4719-b4c0-be10960ae9c9 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.158222 Dec 15 19:04:34.502104 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 123/238] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:34 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:34.883343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:34.884276 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:34.890051 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:34.890502 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:34.891805 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:34.892242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:34.916049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0fc3d55b-98b5-4eb8-a3e3-5f6c495eef6e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:34.916587 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0fc3d55b-98b5-4eb8-a3e3-5f6c495eef6e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:34.922376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0fc3d55b-98b5-4eb8-a3e3-5f6c495eef6e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:34.922827 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0fc3d55b-98b5-4eb8-a3e3-5f6c495eef6e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:34.923620 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0fc3d55b-98b5-4eb8-a3e3-5f6c495eef6e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:34.924059 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0fc3d55b-98b5-4eb8-a3e3-5f6c495eef6e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:35.031565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:35.040738 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:35.042493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:35.043841 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ea0782b3-b5de-411a-a245-c93d6036ba66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.164100 Dec 15 19:04:35.044773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 116/239] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:34 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:35.070575 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0fc3d55b-98b5-4eb8-a3e3-5f6c495eef6e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:35.078051 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0fc3d55b-98b5-4eb8-a3e3-5f6c495eef6e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.165791 Dec 15 19:04:35.078626 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 124/240] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:34 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:35.518524 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-00f34e2a-e202-4e6f-b2cd-caa0df41161f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:35.519130 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-00f34e2a-e202-4e6f-b2cd-caa0df41161f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:35.525278 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-00f34e2a-e202-4e6f-b2cd-caa0df41161f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:35.525730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-00f34e2a-e202-4e6f-b2cd-caa0df41161f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:35.526624 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-00f34e2a-e202-4e6f-b2cd-caa0df41161f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:35.527060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-00f34e2a-e202-4e6f-b2cd-caa0df41161f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:35.659656 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-00f34e2a-e202-4e6f-b2cd-caa0df41161f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:35.667148 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-00f34e2a-e202-4e6f-b2cd-caa0df41161f tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1313 microversion: 2.1 time: 0.152387 Dec 15 19:04:35.667713 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 117/241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:35 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:36.061657 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:36.062264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:36.068222 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:36.068677 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:36.069552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:36.070052 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:36.094848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b7fc73c7-9a09-4834-80ef-f8b62e1fa523 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:36.095444 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b7fc73c7-9a09-4834-80ef-f8b62e1fa523 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:36.102601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7fc73c7-9a09-4834-80ef-f8b62e1fa523 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:36.103055 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7fc73c7-9a09-4834-80ef-f8b62e1fa523 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:36.103838 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7fc73c7-9a09-4834-80ef-f8b62e1fa523 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:36.104272 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7fc73c7-9a09-4834-80ef-f8b62e1fa523 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:36.225671 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:36.230863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:36.232424 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:36.233542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-767f41ba-f92f-48c3-8853-1195b62ad3e2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1403 microversion: 2.20 time: 0.175607 Dec 15 19:04:36.234114 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 125/242] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:36 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1403 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:36.272321 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b7fc73c7-9a09-4834-80ef-f8b62e1fa523 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:36.281585 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b7fc73c7-9a09-4834-80ef-f8b62e1fa523 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.190768 Dec 15 19:04:36.283314 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 118/243] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:36 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:36.684213 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8adf23af-0526-4d85-bb67-99e7707e5f44 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:36.684849 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8adf23af-0526-4d85-bb67-99e7707e5f44 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:36.691729 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8adf23af-0526-4d85-bb67-99e7707e5f44 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:36.692834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8adf23af-0526-4d85-bb67-99e7707e5f44 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:36.693645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8adf23af-0526-4d85-bb67-99e7707e5f44 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:36.694083 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8adf23af-0526-4d85-bb67-99e7707e5f44 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:36.823357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8adf23af-0526-4d85-bb67-99e7707e5f44 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:36.831233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8adf23af-0526-4d85-bb67-99e7707e5f44 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1499 microversion: 2.1 time: 0.150780 Dec 15 19:04:36.831791 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 126/244] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:36 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1499 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:37.251046 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:37.252643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:37.258921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:37.259422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:37.260167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:37.260583 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:37.299471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-308eee64-2af6-479b-83c3-9fae59c5d92f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:37.300076 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-308eee64-2af6-479b-83c3-9fae59c5d92f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:37.305920 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-308eee64-2af6-479b-83c3-9fae59c5d92f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:37.306373 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-308eee64-2af6-479b-83c3-9fae59c5d92f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:37.307300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-308eee64-2af6-479b-83c3-9fae59c5d92f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:37.307737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-308eee64-2af6-479b-83c3-9fae59c5d92f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:37.399037 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:37.407492 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:37.409581 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:37.410725 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5acf47c6-df91-4508-ae1c-0bd55ae2746f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1594 microversion: 2.20 time: 0.163421 Dec 15 19:04:37.411339 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 119/245] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:04:37 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1594 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:37.430500 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b0180835-acbf-481c-b7c0-5ab5e6fb70a8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:37.431001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b0180835-acbf-481c-b7c0-5ab5e6fb70a8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:37.436734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b0180835-acbf-481c-b7c0-5ab5e6fb70a8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:37.437208 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b0180835-acbf-481c-b7c0-5ab5e6fb70a8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:37.437986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b0180835-acbf-481c-b7c0-5ab5e6fb70a8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:37.438416 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b0180835-acbf-481c-b7c0-5ab5e6fb70a8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:37.460180 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-308eee64-2af6-479b-83c3-9fae59c5d92f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:37.478108 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-308eee64-2af6-479b-83c3-9fae59c5d92f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.182766 Dec 15 19:04:37.478657 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 127/246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:37 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:37.568666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b0180835-acbf-481c-b7c0-5ab5e6fb70a8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.141859 Dec 15 19:04:37.569460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 120/247] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Dec 15 19:04:37 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:04:38.495210 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f7ad548f-4a88-40bf-9315-dc7346ee0853 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:38.495749 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f7ad548f-4a88-40bf-9315-dc7346ee0853 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:38.502332 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f7ad548f-4a88-40bf-9315-dc7346ee0853 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:38.502783 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f7ad548f-4a88-40bf-9315-dc7346ee0853 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:38.503664 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f7ad548f-4a88-40bf-9315-dc7346ee0853 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:38.504100 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f7ad548f-4a88-40bf-9315-dc7346ee0853 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:38.644792 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f7ad548f-4a88-40bf-9315-dc7346ee0853 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:38.652684 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f7ad548f-4a88-40bf-9315-dc7346ee0853 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.160683 Dec 15 19:04:38.653344 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 128/248] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:38 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:38.955801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c7b3a925-304f-40b6-8e33-18fd8b36aa66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:38.956838 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c7b3a925-304f-40b6-8e33-18fd8b36aa66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:38.960992 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-90eb46c0-53d1-4c5a-9178-e3ec03e09ca9 req-bccdb0b6-417b-4bf6-9a98-f1dacbd65040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93490542-6e11-41c3-9901-c06a1dd65cef", "tag": "2c56f2d3-88c3-4e37-b62b-41f5e58fee33"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:38.962592 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:04:38.962592 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:04:38.963168 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c7b3a925-304f-40b6-8e33-18fd8b36aa66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:38.963683 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c7b3a925-304f-40b6-8e33-18fd8b36aa66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:38.964532 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c7b3a925-304f-40b6-8e33-18fd8b36aa66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:38.965136 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c7b3a925-304f-40b6-8e33-18fd8b36aa66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:38.969416 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-90eb46c0-53d1-4c5a-9178-e3ec03e09ca9 req-bccdb0b6-417b-4bf6-9a98-f1dacbd65040 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:38.969862 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-90eb46c0-53d1-4c5a-9178-e3ec03e09ca9 req-bccdb0b6-417b-4bf6-9a98-f1dacbd65040 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:38.981574 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-90eb46c0-53d1-4c5a-9178-e3ec03e09ca9 req-bccdb0b6-417b-4bf6-9a98-f1dacbd65040 service nova] Creating event network-changed:2c56f2d3-88c3-4e37-b62b-41f5e58fee33 for instance 93490542-6e11-41c3-9901-c06a1dd65cef on hv-cinder-81268 Dec 15 19:04:38.987145 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-90eb46c0-53d1-4c5a-9178-e3ec03e09ca9 req-bccdb0b6-417b-4bf6-9a98-f1dacbd65040 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029647 Dec 15 19:04:38.987748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 129/249] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:04:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:04:39.669149 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6a1560e9-dde6-43fb-8697-660fcb2b8e55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:39.669871 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6a1560e9-dde6-43fb-8697-660fcb2b8e55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:39.678877 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a1560e9-dde6-43fb-8697-660fcb2b8e55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:39.679884 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a1560e9-dde6-43fb-8697-660fcb2b8e55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:39.681160 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a1560e9-dde6-43fb-8697-660fcb2b8e55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:39.681787 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a1560e9-dde6-43fb-8697-660fcb2b8e55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:39.712860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c7b3a925-304f-40b6-8e33-18fd8b36aa66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 14 microversion: 2.20 time: 0.760597 Dec 15 19:04:39.713518 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 121/250] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:38 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 14 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:39.879649 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6a1560e9-dde6-43fb-8697-660fcb2b8e55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:39.888431 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6a1560e9-dde6-43fb-8697-660fcb2b8e55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1322 microversion: 2.1 time: 0.222991 Dec 15 19:04:39.889166 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 130/251] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:39 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:40.724437 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9334fac1-d7bb-4d53-88c4-97f277a8c9bc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:40.725491 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9334fac1-d7bb-4d53-88c4-97f277a8c9bc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:40.741913 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9334fac1-d7bb-4d53-88c4-97f277a8c9bc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:40.742370 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9334fac1-d7bb-4d53-88c4-97f277a8c9bc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:40.743169 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9334fac1-d7bb-4d53-88c4-97f277a8c9bc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:40.743941 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9334fac1-d7bb-4d53-88c4-97f277a8c9bc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:40.823591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9334fac1-d7bb-4d53-88c4-97f277a8c9bc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 14 microversion: 2.20 time: 0.103332 Dec 15 19:04:40.824228 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 122/252] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:40 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:40.907437 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a65bb2ad-2d08-48db-8e15-abe669c69561 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:40.908044 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a65bb2ad-2d08-48db-8e15-abe669c69561 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:40.913900 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a65bb2ad-2d08-48db-8e15-abe669c69561 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:40.914348 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a65bb2ad-2d08-48db-8e15-abe669c69561 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:40.915121 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a65bb2ad-2d08-48db-8e15-abe669c69561 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:40.915552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a65bb2ad-2d08-48db-8e15-abe669c69561 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:41.046296 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a65bb2ad-2d08-48db-8e15-abe669c69561 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:41.055073 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a65bb2ad-2d08-48db-8e15-abe669c69561 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1516 microversion: 2.1 time: 0.149968 Dec 15 19:04:41.055073 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 131/253] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:40 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:41.071747 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-811eac91-3a38-4a1d-b30b-79fb4748352e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:41.073153 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-811eac91-3a38-4a1d-b30b-79fb4748352e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:41.080735 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-811eac91-3a38-4a1d-b30b-79fb4748352e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:41.081211 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-811eac91-3a38-4a1d-b30b-79fb4748352e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:41.081998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-811eac91-3a38-4a1d-b30b-79fb4748352e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:41.082474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-811eac91-3a38-4a1d-b30b-79fb4748352e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:41.106879 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-811eac91-3a38-4a1d-b30b-79fb4748352e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lazy-loading 'flavor' on Instance uuid 0f02ea25-0aca-4414-a953-d09699b8d014 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:04:41.488167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-811eac91-3a38-4a1d-b30b-79fb4748352e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "POST /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014/action" status: 200 len: 32 microversion: 2.1 time: 0.420595 Dec 15 19:04:41.488813 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 123/254] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:04:41 2021] POST /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:04:41.497463 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-63e45d0f-3c46-42cd-92de-ca84f099439a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:41.498140 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-63e45d0f-3c46-42cd-92de-ca84f099439a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:41.504555 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-63e45d0f-3c46-42cd-92de-ca84f099439a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:41.505065 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-63e45d0f-3c46-42cd-92de-ca84f099439a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:41.505880 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-63e45d0f-3c46-42cd-92de-ca84f099439a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:41.506317 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-63e45d0f-3c46-42cd-92de-ca84f099439a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:41.560143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f5ef0f4e-55b0-40f5-b089-cfdacb442674 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63cf922e-0292-4b36-b46c-7337b47e9566"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:41.561496 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f5ef0f4e-55b0-40f5-b089-cfdacb442674 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:41.568361 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f5ef0f4e-55b0-40f5-b089-cfdacb442674 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:41.568819 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f5ef0f4e-55b0-40f5-b089-cfdacb442674 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:41.569648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f5ef0f4e-55b0-40f5-b089-cfdacb442674 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:41.570091 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f5ef0f4e-55b0-40f5-b089-cfdacb442674 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:41.727234 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-63e45d0f-3c46-42cd-92de-ca84f099439a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:41.735251 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-63e45d0f-3c46-42cd-92de-ca84f099439a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.241362 Dec 15 19:04:41.736962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 132/255] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:41 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:41.771708 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a87258fe-7c90-46f1-a8de-ac5c1833adcf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "082b59ee-8547-4534-b523-f6256b5f35f8"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:41.773278 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a87258fe-7c90-46f1-a8de-ac5c1833adcf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:41.782020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a87258fe-7c90-46f1-a8de-ac5c1833adcf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:41.783269 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a87258fe-7c90-46f1-a8de-ac5c1833adcf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:41.783718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a87258fe-7c90-46f1-a8de-ac5c1833adcf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:41.784148 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a87258fe-7c90-46f1-a8de-ac5c1833adcf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:42.467744 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f5ef0f4e-55b0-40f5-b089-cfdacb442674 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "POST /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911650 Dec 15 19:04:42.468398 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 124/256] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:04:41 2021] POST /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:04:42.479128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0a242c80-ee82-4771-8331-67671a4f80a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:42.480364 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0a242c80-ee82-4771-8331-67671a4f80a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:42.486592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a242c80-ee82-4771-8331-67671a4f80a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:42.487048 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a242c80-ee82-4771-8331-67671a4f80a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:42.487836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a242c80-ee82-4771-8331-67671a4f80a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:42.488271 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a242c80-ee82-4771-8331-67671a4f80a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:42.552801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0a242c80-ee82-4771-8331-67671a4f80a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 14 microversion: 2.20 time: 0.081131 Dec 15 19:04:42.553782 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 125/257] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:42 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:42.754397 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9bb05796-077b-48e8-a724-6ab8bf422c32 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:42.755094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9bb05796-077b-48e8-a724-6ab8bf422c32 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:42.764701 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9bb05796-077b-48e8-a724-6ab8bf422c32 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:42.765183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9bb05796-077b-48e8-a724-6ab8bf422c32 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:42.766445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9bb05796-077b-48e8-a724-6ab8bf422c32 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:42.767075 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9bb05796-077b-48e8-a724-6ab8bf422c32 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:42.794133 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a87258fe-7c90-46f1-a8de-ac5c1833adcf tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "POST /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025811 Dec 15 19:04:42.795280 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 133/258] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:04:41 2021] POST /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293/os-volume_attachments => generated 194 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:04:42.949231 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9bb05796-077b-48e8-a724-6ab8bf422c32 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:42.957068 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9bb05796-077b-48e8-a724-6ab8bf422c32 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.207245 Dec 15 19:04:42.958164 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 126/259] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:42 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:43.564760 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2f278c36-06bf-4cf0-9184-2f0d8436aed7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:43.565922 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2f278c36-06bf-4cf0-9184-2f0d8436aed7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:43.572521 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2f278c36-06bf-4cf0-9184-2f0d8436aed7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:43.572966 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2f278c36-06bf-4cf0-9184-2f0d8436aed7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:43.584079 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2f278c36-06bf-4cf0-9184-2f0d8436aed7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:43.584562 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2f278c36-06bf-4cf0-9184-2f0d8436aed7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:43.663316 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2f278c36-06bf-4cf0-9184-2f0d8436aed7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 14 microversion: 2.20 time: 0.102859 Dec 15 19:04:43.663937 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 134/260] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:43 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:43.974894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0488e507-2013-4802-8009-9a7a1927738f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:43.975715 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0488e507-2013-4802-8009-9a7a1927738f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:43.982250 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0488e507-2013-4802-8009-9a7a1927738f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:43.982739 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0488e507-2013-4802-8009-9a7a1927738f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:43.984300 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0488e507-2013-4802-8009-9a7a1927738f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:43.984962 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0488e507-2013-4802-8009-9a7a1927738f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:44.130922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0488e507-2013-4802-8009-9a7a1927738f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:44.138750 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0488e507-2013-4802-8009-9a7a1927738f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.168475 Dec 15 19:04:44.139361 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 127/261] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:43 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:44.674382 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fd194401-a7ab-42b4-8534-c48498a5d7fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:44.675370 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fd194401-a7ab-42b4-8534-c48498a5d7fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:44.682380 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fd194401-a7ab-42b4-8534-c48498a5d7fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:44.682827 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fd194401-a7ab-42b4-8534-c48498a5d7fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:44.683610 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fd194401-a7ab-42b4-8534-c48498a5d7fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:44.684113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fd194401-a7ab-42b4-8534-c48498a5d7fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:44.752957 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fd194401-a7ab-42b4-8534-c48498a5d7fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 14 microversion: 2.20 time: 0.082468 Dec 15 19:04:44.753836 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 135/262] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:44 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:45.163643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0c919af4-c6f8-43d8-9723-0a0ff068994b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:45.163643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0c919af4-c6f8-43d8-9723-0a0ff068994b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:45.163643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c919af4-c6f8-43d8-9723-0a0ff068994b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:45.164325 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c919af4-c6f8-43d8-9723-0a0ff068994b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:45.165692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c919af4-c6f8-43d8-9723-0a0ff068994b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:45.166136 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c919af4-c6f8-43d8-9723-0a0ff068994b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:45.309876 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0c919af4-c6f8-43d8-9723-0a0ff068994b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:45.317994 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0c919af4-c6f8-43d8-9723-0a0ff068994b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.165771 Dec 15 19:04:45.318819 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 128/263] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:45 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:45.764538 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e093d40a-3504-4d48-a5ce-fdbf6e1ff02b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:45.765792 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e093d40a-3504-4d48-a5ce-fdbf6e1ff02b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:45.772558 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e093d40a-3504-4d48-a5ce-fdbf6e1ff02b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:45.772998 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e093d40a-3504-4d48-a5ce-fdbf6e1ff02b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:45.773808 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e093d40a-3504-4d48-a5ce-fdbf6e1ff02b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:45.774230 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e093d40a-3504-4d48-a5ce-fdbf6e1ff02b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:45.839045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e093d40a-3504-4d48-a5ce-fdbf6e1ff02b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 14 microversion: 2.20 time: 0.078386 Dec 15 19:04:45.840167 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 136/264] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:45 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:46.334869 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6cc81834-98eb-428e-914c-9e82c474bc25 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:46.336798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6cc81834-98eb-428e-914c-9e82c474bc25 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:46.342195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6cc81834-98eb-428e-914c-9e82c474bc25 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:46.342836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6cc81834-98eb-428e-914c-9e82c474bc25 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:46.343984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6cc81834-98eb-428e-914c-9e82c474bc25 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:46.344603 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6cc81834-98eb-428e-914c-9e82c474bc25 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:46.493553 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6cc81834-98eb-428e-914c-9e82c474bc25 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:46.502448 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6cc81834-98eb-428e-914c-9e82c474bc25 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.170000 Dec 15 19:04:46.503111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 129/265] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:46 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:46.850469 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-50fc739a-8fd3-42cb-825b-cdae7f187965 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:46.851451 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-50fc739a-8fd3-42cb-825b-cdae7f187965 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:46.858120 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-50fc739a-8fd3-42cb-825b-cdae7f187965 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:46.858560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-50fc739a-8fd3-42cb-825b-cdae7f187965 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:46.859328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-50fc739a-8fd3-42cb-825b-cdae7f187965 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:46.859759 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-50fc739a-8fd3-42cb-825b-cdae7f187965 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:47.523403 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-13fd202b-c11c-4ad7-912a-d554073cd704 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:47.524777 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-13fd202b-c11c-4ad7-912a-d554073cd704 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:47.534631 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-13fd202b-c11c-4ad7-912a-d554073cd704 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:47.535109 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-13fd202b-c11c-4ad7-912a-d554073cd704 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:47.535893 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-13fd202b-c11c-4ad7-912a-d554073cd704 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:47.536331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-13fd202b-c11c-4ad7-912a-d554073cd704 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:47.708223 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-13fd202b-c11c-4ad7-912a-d554073cd704 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:47.715498 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-13fd202b-c11c-4ad7-912a-d554073cd704 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.198511 Dec 15 19:04:47.716072 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 130/266] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:47 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:48.732775 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d1247136-4a19-4bc3-bbd0-fa550816530f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:48.733530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d1247136-4a19-4bc3-bbd0-fa550816530f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:48.740867 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1247136-4a19-4bc3-bbd0-fa550816530f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:48.741344 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1247136-4a19-4bc3-bbd0-fa550816530f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:48.742143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1247136-4a19-4bc3-bbd0-fa550816530f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:48.742565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1247136-4a19-4bc3-bbd0-fa550816530f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:48.918267 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d1247136-4a19-4bc3-bbd0-fa550816530f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:48.925605 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d1247136-4a19-4bc3-bbd0-fa550816530f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.196656 Dec 15 19:04:48.926170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 131/267] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:48 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:49.127149 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-50fc739a-8fd3-42cb-825b-cdae7f187965 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 14 microversion: 2.20 time: 2.279380 Dec 15 19:04:49.127149 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 137/268] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:46 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 14 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:49.942994 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-97551b7e-02b0-4cd0-bf70-30758e3d4613 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:49.948339 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-97551b7e-02b0-4cd0-bf70-30758e3d4613 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:49.950564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-97551b7e-02b0-4cd0-bf70-30758e3d4613 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:49.950564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-97551b7e-02b0-4cd0-bf70-30758e3d4613 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:49.951238 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-97551b7e-02b0-4cd0-bf70-30758e3d4613 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:49.951677 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-97551b7e-02b0-4cd0-bf70-30758e3d4613 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:50.096876 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-97551b7e-02b0-4cd0-bf70-30758e3d4613 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:50.105583 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-97551b7e-02b0-4cd0-bf70-30758e3d4613 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.166783 Dec 15 19:04:50.106111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 132/269] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:49 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:50.138371 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-802f2a87-88dc-4df0-89f0-cb7b95a68283 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:50.139621 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-802f2a87-88dc-4df0-89f0-cb7b95a68283 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:50.146879 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-802f2a87-88dc-4df0-89f0-cb7b95a68283 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:50.147326 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-802f2a87-88dc-4df0-89f0-cb7b95a68283 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:50.148130 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-802f2a87-88dc-4df0-89f0-cb7b95a68283 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:50.148560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-802f2a87-88dc-4df0-89f0-cb7b95a68283 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:50.222482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-802f2a87-88dc-4df0-89f0-cb7b95a68283 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 14 microversion: 2.20 time: 0.088787 Dec 15 19:04:50.223156 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 138/270] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:50 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:51.122253 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e2917804-e1a8-4954-9d27-7b2e7831d768 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:51.123122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e2917804-e1a8-4954-9d27-7b2e7831d768 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:51.130037 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e2917804-e1a8-4954-9d27-7b2e7831d768 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:51.130673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e2917804-e1a8-4954-9d27-7b2e7831d768 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:51.131685 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e2917804-e1a8-4954-9d27-7b2e7831d768 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:51.132129 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e2917804-e1a8-4954-9d27-7b2e7831d768 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:51.236318 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-34b16804-8fa5-496d-9fc6-8eaa75038f38 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:51.236318 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-34b16804-8fa5-496d-9fc6-8eaa75038f38 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:51.243769 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-34b16804-8fa5-496d-9fc6-8eaa75038f38 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:51.244214 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-34b16804-8fa5-496d-9fc6-8eaa75038f38 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:51.245023 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-34b16804-8fa5-496d-9fc6-8eaa75038f38 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:51.245480 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-34b16804-8fa5-496d-9fc6-8eaa75038f38 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:51.300245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e2917804-e1a8-4954-9d27-7b2e7831d768 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:51.308303 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e2917804-e1a8-4954-9d27-7b2e7831d768 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.189664 Dec 15 19:04:51.308885 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 133/271] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:51 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:51.348822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-34b16804-8fa5-496d-9fc6-8eaa75038f38 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 14 microversion: 2.20 time: 0.118676 Dec 15 19:04:51.349905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 139/272] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:51 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:52.327534 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-dc1da8a7-cf14-453e-a6b4-9efce85ee8ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:52.328259 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-dc1da8a7-cf14-453e-a6b4-9efce85ee8ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:52.335978 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dc1da8a7-cf14-453e-a6b4-9efce85ee8ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:52.336694 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dc1da8a7-cf14-453e-a6b4-9efce85ee8ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:52.337682 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dc1da8a7-cf14-453e-a6b4-9efce85ee8ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:52.338300 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dc1da8a7-cf14-453e-a6b4-9efce85ee8ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:52.361021 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-631b1e80-02e7-47c6-9e3d-a529a3846c5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:52.362603 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-631b1e80-02e7-47c6-9e3d-a529a3846c5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:52.371565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-631b1e80-02e7-47c6-9e3d-a529a3846c5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:52.372021 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-631b1e80-02e7-47c6-9e3d-a529a3846c5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:52.373297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-631b1e80-02e7-47c6-9e3d-a529a3846c5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:52.373733 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-631b1e80-02e7-47c6-9e3d-a529a3846c5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:52.480554 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-631b1e80-02e7-47c6-9e3d-a529a3846c5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 6017 microversion: 2.20 time: 0.123632 Dec 15 19:04:52.481971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 140/273] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:52 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 6017 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:04:52.552183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-dc1da8a7-cf14-453e-a6b4-9efce85ee8ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:52.559964 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-dc1da8a7-cf14-453e-a6b4-9efce85ee8ac tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.236609 Dec 15 19:04:52.560568 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 134/274] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:52 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:52.665561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-244558058", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "networks": [{"uuid": "9b5341ac-959a-4f9c-b267-56c4cfd3994a"}]}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:52.722890 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.network.neutron [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] validate_networks() for [('9b5341ac-959a-4f9c-b267-56c4cfd3994a', None, None, None, None, None)] {{(pid=116515) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:04:53.087797 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Flavor limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:04:53.088215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Image limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:04:53.088756 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Flavor pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:04:53.089192 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Image pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:04:53.089663 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:04:53.099112 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:53.099556 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:53.100409 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:53.100910 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:53.117046 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Getting quotas for project 52e4764fb4d34d5dbdd967080b99c537. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:04:53.121740 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Getting quotas for user d79566c6c23e4944aadc60c1957cff95 and project 52e4764fb4d34d5dbdd967080b99c537. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:04:53.134100 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Going to run 1 instances... {{(pid=116515) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:04:53.136759 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:04:53.271299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-37482a51-a7aa-470a-ba82-725043cc3def tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609605 Dec 15 19:04:53.272082 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 141/275] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:04:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:04:53.282182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-87fbc3ac-8892-404c-9e5c-f0737bec53cc tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:53.282821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-87fbc3ac-8892-404c-9e5c-f0737bec53cc tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:53.346150 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-87fbc3ac-8892-404c-9e5c-f0737bec53cc tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:53.354103 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-87fbc3ac-8892-404c-9e5c-f0737bec53cc tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1217 microversion: 2.1 time: 0.075907 Dec 15 19:04:53.355385 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 135/276] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:53 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:53.492277 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-18e3c309-b7ab-44e9-bd7a-cd3131eca069 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:53.493276 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-18e3c309-b7ab-44e9-bd7a-cd3131eca069 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:53.499879 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-18e3c309-b7ab-44e9-bd7a-cd3131eca069 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:53.500298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-18e3c309-b7ab-44e9-bd7a-cd3131eca069 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:53.501677 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-18e3c309-b7ab-44e9-bd7a-cd3131eca069 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:53.502117 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-18e3c309-b7ab-44e9-bd7a-cd3131eca069 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:53.577987 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1d1ebfac-77ac-453a-99eb-26a86d5d4347 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:53.579596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1d1ebfac-77ac-453a-99eb-26a86d5d4347 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:53.591074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1d1ebfac-77ac-453a-99eb-26a86d5d4347 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:53.591581 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1d1ebfac-77ac-453a-99eb-26a86d5d4347 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:53.594335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1d1ebfac-77ac-453a-99eb-26a86d5d4347 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:53.595121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1d1ebfac-77ac-453a-99eb-26a86d5d4347 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:53.596400 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-18e3c309-b7ab-44e9-bd7a-cd3131eca069 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 10009 microversion: 2.20 time: 0.107769 Dec 15 19:04:53.597213 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 142/277] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:53 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 10009 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:04:53.749356 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1d1ebfac-77ac-453a-99eb-26a86d5d4347 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:53.757363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1d1ebfac-77ac-453a-99eb-26a86d5d4347 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.183450 Dec 15 19:04:53.761556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 136/278] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:53 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:54.374945 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4046a13a-0649-40f0-9ac8-ca263f9f10e2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:54.374945 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4046a13a-0649-40f0-9ac8-ca263f9f10e2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:54.380276 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4046a13a-0649-40f0-9ac8-ca263f9f10e2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:54.380724 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4046a13a-0649-40f0-9ac8-ca263f9f10e2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:54.381548 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4046a13a-0649-40f0-9ac8-ca263f9f10e2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:54.381982 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4046a13a-0649-40f0-9ac8-ca263f9f10e2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:54.455856 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4046a13a-0649-40f0-9ac8-ca263f9f10e2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:54.463724 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4046a13a-0649-40f0-9ac8-ca263f9f10e2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1221 microversion: 2.1 time: 0.095789 Dec 15 19:04:54.464402 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 143/279] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:54 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:54.607571 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6824551b-cbdb-4106-9540-61d76335dc09 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:54.608870 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6824551b-cbdb-4106-9540-61d76335dc09 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:54.616863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6824551b-cbdb-4106-9540-61d76335dc09 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:54.616863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6824551b-cbdb-4106-9540-61d76335dc09 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:54.616863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6824551b-cbdb-4106-9540-61d76335dc09 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:54.617246 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6824551b-cbdb-4106-9540-61d76335dc09 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:54.705953 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6824551b-cbdb-4106-9540-61d76335dc09 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 13822 microversion: 2.20 time: 0.101873 Dec 15 19:04:54.719087 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 137/280] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:54 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 13822 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:04:54.777747 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3f65735c-49c7-4e35-b860-7726687b3527 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:54.779296 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3f65735c-49c7-4e35-b860-7726687b3527 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:54.786499 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f65735c-49c7-4e35-b860-7726687b3527 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:54.786957 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f65735c-49c7-4e35-b860-7726687b3527 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:54.787761 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f65735c-49c7-4e35-b860-7726687b3527 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:54.788201 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f65735c-49c7-4e35-b860-7726687b3527 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:54.931684 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3f65735c-49c7-4e35-b860-7726687b3527 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:54.938831 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3f65735c-49c7-4e35-b860-7726687b3527 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.168098 Dec 15 19:04:54.943834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 144/281] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:54 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:55.482565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f955d0de-7865-4cb5-94c3-3fc0dcd769b2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:55.483271 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f955d0de-7865-4cb5-94c3-3fc0dcd769b2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:55.490252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f955d0de-7865-4cb5-94c3-3fc0dcd769b2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:55.490773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f955d0de-7865-4cb5-94c3-3fc0dcd769b2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:55.491807 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f955d0de-7865-4cb5-94c3-3fc0dcd769b2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:55.492245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f955d0de-7865-4cb5-94c3-3fc0dcd769b2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:55.559522 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f955d0de-7865-4cb5-94c3-3fc0dcd769b2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:55.569895 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f955d0de-7865-4cb5-94c3-3fc0dcd769b2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1269 microversion: 2.1 time: 0.091194 Dec 15 19:04:55.570633 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 138/282] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:55 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:55.717615 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f5664b78-f7bc-41c5-99d0-80106e92c031 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:55.718624 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f5664b78-f7bc-41c5-99d0-80106e92c031 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:55.726483 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f5664b78-f7bc-41c5-99d0-80106e92c031 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:55.726483 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f5664b78-f7bc-41c5-99d0-80106e92c031 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:55.726483 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f5664b78-f7bc-41c5-99d0-80106e92c031 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:55.726737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f5664b78-f7bc-41c5-99d0-80106e92c031 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:55.828295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f5664b78-f7bc-41c5-99d0-80106e92c031 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 16678 microversion: 2.20 time: 0.114210 Dec 15 19:04:55.828961 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 145/283] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:55 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 16678 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:04:55.955916 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9107e56a-da02-40e2-8582-3ce4a1b7c64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:55.956521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9107e56a-da02-40e2-8582-3ce4a1b7c64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:55.962767 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9107e56a-da02-40e2-8582-3ce4a1b7c64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:55.963219 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9107e56a-da02-40e2-8582-3ce4a1b7c64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:55.964036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9107e56a-da02-40e2-8582-3ce4a1b7c64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:55.964472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9107e56a-da02-40e2-8582-3ce4a1b7c64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:56.143490 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9107e56a-da02-40e2-8582-3ce4a1b7c64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:56.151603 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9107e56a-da02-40e2-8582-3ce4a1b7c64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.199276 Dec 15 19:04:56.152710 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 139/284] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:55 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:56.588014 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-42167619-b00b-48f4-9be7-16972ed78141 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:56.588757 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-42167619-b00b-48f4-9be7-16972ed78141 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:56.595518 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-42167619-b00b-48f4-9be7-16972ed78141 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:56.595959 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-42167619-b00b-48f4-9be7-16972ed78141 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:56.596765 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-42167619-b00b-48f4-9be7-16972ed78141 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:56.597220 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-42167619-b00b-48f4-9be7-16972ed78141 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:56.687509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-42167619-b00b-48f4-9be7-16972ed78141 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:56.695584 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-42167619-b00b-48f4-9be7-16972ed78141 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1275 microversion: 2.1 time: 0.111525 Dec 15 19:04:56.696155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 146/285] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:56 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:56.840936 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-68be699b-3537-4a5e-a86a-23d04580a0b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:56.842049 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-68be699b-3537-4a5e-a86a-23d04580a0b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:56.848930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-68be699b-3537-4a5e-a86a-23d04580a0b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:56.849432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-68be699b-3537-4a5e-a86a-23d04580a0b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:56.850184 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-68be699b-3537-4a5e-a86a-23d04580a0b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:56.850734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-68be699b-3537-4a5e-a86a-23d04580a0b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:56.952092 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-68be699b-3537-4a5e-a86a-23d04580a0b4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 17781 microversion: 2.20 time: 0.110616 Dec 15 19:04:56.953121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 140/286] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:56 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 17781 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:04:57.169023 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-81583313-2d4a-4f1e-92ae-802d80124a55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:57.170537 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-81583313-2d4a-4f1e-92ae-802d80124a55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:57.177655 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81583313-2d4a-4f1e-92ae-802d80124a55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:57.178782 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81583313-2d4a-4f1e-92ae-802d80124a55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:57.179838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81583313-2d4a-4f1e-92ae-802d80124a55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:57.180584 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81583313-2d4a-4f1e-92ae-802d80124a55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:57.408123 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-81583313-2d4a-4f1e-92ae-802d80124a55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:57.420098 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-81583313-2d4a-4f1e-92ae-802d80124a55 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.253897 Dec 15 19:04:57.421284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 147/287] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:57 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:57.716227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f975412e-f33d-492a-8094-bc8776de7474 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:57.716932 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f975412e-f33d-492a-8094-bc8776de7474 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:57.733278 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f975412e-f33d-492a-8094-bc8776de7474 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:57.736596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f975412e-f33d-492a-8094-bc8776de7474 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:57.737539 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f975412e-f33d-492a-8094-bc8776de7474 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:57.738576 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f975412e-f33d-492a-8094-bc8776de7474 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:57.965031 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d1e30fb9-2f1c-429f-a932-75de22c516db tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:57.966379 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d1e30fb9-2f1c-429f-a932-75de22c516db tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:57.978719 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1e30fb9-2f1c-429f-a932-75de22c516db tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:57.980481 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1e30fb9-2f1c-429f-a932-75de22c516db tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:57.981734 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1e30fb9-2f1c-429f-a932-75de22c516db tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:57.982411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1e30fb9-2f1c-429f-a932-75de22c516db tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:58.036386 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f975412e-f33d-492a-8094-bc8776de7474 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:58.048785 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f975412e-f33d-492a-8094-bc8776de7474 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.334479 Dec 15 19:04:58.051518 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 141/288] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:57 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:58.064630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-4035033f-bb5f-410d-8450-a9d8e1a4ede7 req-bfef8070-2175-49d9-9363-333ab686da09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094752c1-e6f8-47d3-b40b-b20e8e8c12e6", "tag": "b3a88158-4982-4b94-94f5-9d2a3ecf2eb1"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:58.066605 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:04:58.066605 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:04:58.076121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-4035033f-bb5f-410d-8450-a9d8e1a4ede7 req-bfef8070-2175-49d9-9363-333ab686da09 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:58.076772 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-4035033f-bb5f-410d-8450-a9d8e1a4ede7 req-bfef8070-2175-49d9-9363-333ab686da09 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:58.090478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-4035033f-bb5f-410d-8450-a9d8e1a4ede7 req-bfef8070-2175-49d9-9363-333ab686da09 service nova] Creating event network-changed:b3a88158-4982-4b94-94f5-9d2a3ecf2eb1 for instance 094752c1-e6f8-47d3-b40b-b20e8e8c12e6 on hv-cinder-81268 Dec 15 19:04:58.098092 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-4035033f-bb5f-410d-8450-a9d8e1a4ede7 req-bfef8070-2175-49d9-9363-333ab686da09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045535 Dec 15 19:04:58.099445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 142/289] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:04:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:04:58.135742 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d1e30fb9-2f1c-429f-a932-75de22c516db tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 18772 microversion: 2.20 time: 0.175503 Dec 15 19:04:58.142223 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 148/290] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:57 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 18772 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:04:58.437186 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2a7e9871-8cdc-468e-af6f-c67c8b730aa4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:58.437872 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2a7e9871-8cdc-468e-af6f-c67c8b730aa4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:58.444860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2a7e9871-8cdc-468e-af6f-c67c8b730aa4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:58.445392 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2a7e9871-8cdc-468e-af6f-c67c8b730aa4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:58.446181 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2a7e9871-8cdc-468e-af6f-c67c8b730aa4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:58.446616 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2a7e9871-8cdc-468e-af6f-c67c8b730aa4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:58.588968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2a7e9871-8cdc-468e-af6f-c67c8b730aa4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:58.596431 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2a7e9871-8cdc-468e-af6f-c67c8b730aa4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.163358 Dec 15 19:04:58.597303 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 143/291] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:58 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:04:59.067912 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c958b633-27d7-49f1-95e9-7cf39fc3bb50 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:59.068657 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c958b633-27d7-49f1-95e9-7cf39fc3bb50 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:59.076867 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c958b633-27d7-49f1-95e9-7cf39fc3bb50 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:59.079222 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c958b633-27d7-49f1-95e9-7cf39fc3bb50 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:59.079222 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c958b633-27d7-49f1-95e9-7cf39fc3bb50 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:59.079222 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c958b633-27d7-49f1-95e9-7cf39fc3bb50 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:59.151857 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ec2672cf-feaf-4a8f-91ca-3327877e2648 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:04:59.152675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ec2672cf-feaf-4a8f-91ca-3327877e2648 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:59.159515 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec2672cf-feaf-4a8f-91ca-3327877e2648 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:59.159975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec2672cf-feaf-4a8f-91ca-3327877e2648 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:59.160930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec2672cf-feaf-4a8f-91ca-3327877e2648 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:59.161459 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec2672cf-feaf-4a8f-91ca-3327877e2648 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:59.211697 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c958b633-27d7-49f1-95e9-7cf39fc3bb50 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:59.219875 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c958b633-27d7-49f1-95e9-7cf39fc3bb50 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.155455 Dec 15 19:04:59.220270 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 149/292] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:59 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:04:59.273119 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ec2672cf-feaf-4a8f-91ca-3327877e2648 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 20172 microversion: 2.20 time: 0.124758 Dec 15 19:04:59.274929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 144/293] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:04:59 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 20172 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:04:59.614338 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-66fe8ae9-396f-4c2d-847f-94c8ef2c97c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:04:59.615036 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-66fe8ae9-396f-4c2d-847f-94c8ef2c97c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:04:59.622028 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66fe8ae9-396f-4c2d-847f-94c8ef2c97c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:59.623596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66fe8ae9-396f-4c2d-847f-94c8ef2c97c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:59.623596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66fe8ae9-396f-4c2d-847f-94c8ef2c97c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:04:59.624246 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66fe8ae9-396f-4c2d-847f-94c8ef2c97c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:04:59.784908 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-66fe8ae9-396f-4c2d-847f-94c8ef2c97c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:04:59.792225 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-66fe8ae9-396f-4c2d-847f-94c8ef2c97c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.181707 Dec 15 19:04:59.796505 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 150/294] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:04:59 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:00.080019 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ac4e7590-b897-4f52-a603-be88e30d7632 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:00.080607 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ac4e7590-b897-4f52-a603-be88e30d7632 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:00.087232 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac4e7590-b897-4f52-a603-be88e30d7632 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.087844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac4e7590-b897-4f52-a603-be88e30d7632 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.089123 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac4e7590-b897-4f52-a603-be88e30d7632 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.089123 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac4e7590-b897-4f52-a603-be88e30d7632 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.115191 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ac4e7590-b897-4f52-a603-be88e30d7632 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:05:00.236893 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-af60094b-05a0-4015-910c-1266e30f7d16 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:00.237542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-af60094b-05a0-4015-910c-1266e30f7d16 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:00.244016 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af60094b-05a0-4015-910c-1266e30f7d16 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.244770 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af60094b-05a0-4015-910c-1266e30f7d16 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.245697 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af60094b-05a0-4015-910c-1266e30f7d16 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.246328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af60094b-05a0-4015-910c-1266e30f7d16 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.424120 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-af60094b-05a0-4015-910c-1266e30f7d16 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:00.433106 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-af60094b-05a0-4015-910c-1266e30f7d16 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.200074 Dec 15 19:05:00.433680 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 151/295] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:00 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:00.441469 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ecb7a7a4-a8b8-4ea2-b827-443815781aa7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:00.443101 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ecb7a7a4-a8b8-4ea2-b827-443815781aa7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:00.450783 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ecb7a7a4-a8b8-4ea2-b827-443815781aa7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.451240 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ecb7a7a4-a8b8-4ea2-b827-443815781aa7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.452039 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ecb7a7a4-a8b8-4ea2-b827-443815781aa7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.452474 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ecb7a7a4-a8b8-4ea2-b827-443815781aa7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.541710 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ecb7a7a4-a8b8-4ea2-b827-443815781aa7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 22021 microversion: 2.20 time: 0.106519 Dec 15 19:05:00.542375 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 152/296] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:00 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 22021 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:00.576423 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ac4e7590-b897-4f52-a603-be88e30d7632 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "DELETE /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 204 len: 0 microversion: 2.1 time: 0.500566 Dec 15 19:05:00.577047 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 145/297] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:05:00 2021] DELETE /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:05:00.585252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fc31a11c-ae05-4fa0-ba75-b8f032bfb83e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:00.586152 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fc31a11c-ae05-4fa0-ba75-b8f032bfb83e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:00.593436 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fc31a11c-ae05-4fa0-ba75-b8f032bfb83e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.593940 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fc31a11c-ae05-4fa0-ba75-b8f032bfb83e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.597200 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fc31a11c-ae05-4fa0-ba75-b8f032bfb83e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.597200 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fc31a11c-ae05-4fa0-ba75-b8f032bfb83e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.743850 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fc31a11c-ae05-4fa0-ba75-b8f032bfb83e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:00.751634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fc31a11c-ae05-4fa0-ba75-b8f032bfb83e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1551 microversion: 2.1 time: 0.170369 Dec 15 19:05:00.752216 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 153/298] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:00 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1551 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:00.809756 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-01bb4500-c671-4fce-9b61-e265ad07c891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:00.810448 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-01bb4500-c671-4fce-9b61-e265ad07c891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:00.816907 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01bb4500-c671-4fce-9b61-e265ad07c891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.817413 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01bb4500-c671-4fce-9b61-e265ad07c891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.818214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01bb4500-c671-4fce-9b61-e265ad07c891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:00.818673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01bb4500-c671-4fce-9b61-e265ad07c891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:00.957066 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-01bb4500-c671-4fce-9b61-e265ad07c891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:00.964157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-01bb4500-c671-4fce-9b61-e265ad07c891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.158467 Dec 15 19:05:00.964956 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 146/299] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:00 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:01.450878 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-107454f5-c165-4763-9535-d32d76feea1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:01.451514 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-107454f5-c165-4763-9535-d32d76feea1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:01.466832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-107454f5-c165-4763-9535-d32d76feea1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:01.466832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-107454f5-c165-4763-9535-d32d76feea1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:01.466832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-107454f5-c165-4763-9535-d32d76feea1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:01.466832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-107454f5-c165-4763-9535-d32d76feea1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:01.552766 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bac7ce07-ecf6-4f8a-b80f-7b41f6c53fa6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:01.554414 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bac7ce07-ecf6-4f8a-b80f-7b41f6c53fa6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:01.563812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bac7ce07-ecf6-4f8a-b80f-7b41f6c53fa6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:01.564132 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bac7ce07-ecf6-4f8a-b80f-7b41f6c53fa6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:01.565346 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bac7ce07-ecf6-4f8a-b80f-7b41f6c53fa6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:01.566287 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bac7ce07-ecf6-4f8a-b80f-7b41f6c53fa6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:01.606340 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-107454f5-c165-4763-9535-d32d76feea1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:01.614526 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-107454f5-c165-4763-9535-d32d76feea1d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.167285 Dec 15 19:05:01.615066 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 154/300] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:01 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:01.660397 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bac7ce07-ecf6-4f8a-b80f-7b41f6c53fa6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 23036 microversion: 2.20 time: 0.111078 Dec 15 19:05:01.661659 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 147/301] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:01 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 23036 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:05:01.769268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c80c0fad-c603-4314-a279-91cbe52e2730 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:01.769880 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c80c0fad-c603-4314-a279-91cbe52e2730 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:01.776153 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c80c0fad-c603-4314-a279-91cbe52e2730 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:01.776613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c80c0fad-c603-4314-a279-91cbe52e2730 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:01.777436 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c80c0fad-c603-4314-a279-91cbe52e2730 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:01.777872 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c80c0fad-c603-4314-a279-91cbe52e2730 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:01.982850 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3df076a2-ef10-4292-b5ba-3803e65815d2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:01.983763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3df076a2-ef10-4292-b5ba-3803e65815d2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:01.989674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c80c0fad-c603-4314-a279-91cbe52e2730 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:01.992233 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3df076a2-ef10-4292-b5ba-3803e65815d2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:01.992879 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3df076a2-ef10-4292-b5ba-3803e65815d2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:01.993701 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3df076a2-ef10-4292-b5ba-3803e65815d2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:01.994145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3df076a2-ef10-4292-b5ba-3803e65815d2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:02.007461 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c80c0fad-c603-4314-a279-91cbe52e2730 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1551 microversion: 2.1 time: 0.241694 Dec 15 19:05:02.009549 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 155/302] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:01 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1551 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:02.189890 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3df076a2-ef10-4292-b5ba-3803e65815d2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:02.197811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3df076a2-ef10-4292-b5ba-3803e65815d2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.218896 Dec 15 19:05:02.207554 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 148/303] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:01 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:02.631779 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0c399c0a-6fc3-44ce-9dca-806a335467da tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:02.633290 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0c399c0a-6fc3-44ce-9dca-806a335467da tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:02.639335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0c399c0a-6fc3-44ce-9dca-806a335467da tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:02.642401 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0c399c0a-6fc3-44ce-9dca-806a335467da tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:02.642401 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0c399c0a-6fc3-44ce-9dca-806a335467da tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:02.642401 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0c399c0a-6fc3-44ce-9dca-806a335467da tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:02.678481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c4b81479-1bb8-4bb9-b8fc-d36bff5ff90a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:02.679454 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c4b81479-1bb8-4bb9-b8fc-d36bff5ff90a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:02.710526 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4b81479-1bb8-4bb9-b8fc-d36bff5ff90a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:02.710976 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4b81479-1bb8-4bb9-b8fc-d36bff5ff90a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:02.711964 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4b81479-1bb8-4bb9-b8fc-d36bff5ff90a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:02.712582 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4b81479-1bb8-4bb9-b8fc-d36bff5ff90a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:02.818579 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c4b81479-1bb8-4bb9-b8fc-d36bff5ff90a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 23794 microversion: 2.20 time: 0.149887 Dec 15 19:05:02.835322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 149/304] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:02 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 23794 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:02.869409 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0c399c0a-6fc3-44ce-9dca-806a335467da tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:02.882535 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0c399c0a-6fc3-44ce-9dca-806a335467da tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.254949 Dec 15 19:05:02.884650 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 156/305] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:02 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:03.027588 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-29f902e5-ba72-4770-84bf-e15bc790189b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:03.028603 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-29f902e5-ba72-4770-84bf-e15bc790189b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:03.041832 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-29f902e5-ba72-4770-84bf-e15bc790189b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:03.042512 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-29f902e5-ba72-4770-84bf-e15bc790189b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:03.044000 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-29f902e5-ba72-4770-84bf-e15bc790189b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:03.046377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-29f902e5-ba72-4770-84bf-e15bc790189b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:03.216142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-714e3f92-2b3b-4eb3-80bd-9020df50a737 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:03.217172 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-714e3f92-2b3b-4eb3-80bd-9020df50a737 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:03.224950 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-29f902e5-ba72-4770-84bf-e15bc790189b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:03.232482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-714e3f92-2b3b-4eb3-80bd-9020df50a737 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:03.237915 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-714e3f92-2b3b-4eb3-80bd-9020df50a737 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:03.237915 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-714e3f92-2b3b-4eb3-80bd-9020df50a737 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:03.237915 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-714e3f92-2b3b-4eb3-80bd-9020df50a737 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:03.244226 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-29f902e5-ba72-4770-84bf-e15bc790189b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1551 microversion: 2.1 time: 0.220996 Dec 15 19:05:03.260775 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 150/306] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:03 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1551 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:03.505682 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-714e3f92-2b3b-4eb3-80bd-9020df50a737 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:03.517390 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-714e3f92-2b3b-4eb3-80bd-9020df50a737 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.305275 Dec 15 19:05:03.519238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 157/307] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:03 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:03.876927 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-db0d2f03-8256-4469-8703-b730ed233abe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:03.877848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-db0d2f03-8256-4469-8703-b730ed233abe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:03.884404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db0d2f03-8256-4469-8703-b730ed233abe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:03.884854 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db0d2f03-8256-4469-8703-b730ed233abe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:03.885671 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db0d2f03-8256-4469-8703-b730ed233abe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:03.886143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db0d2f03-8256-4469-8703-b730ed233abe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:03.905575 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-af3cc541-fbb6-4f9a-b47d-ab83b27594a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:03.908272 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-af3cc541-fbb6-4f9a-b47d-ab83b27594a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:03.914952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af3cc541-fbb6-4f9a-b47d-ab83b27594a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:03.915405 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af3cc541-fbb6-4f9a-b47d-ab83b27594a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:03.916238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af3cc541-fbb6-4f9a-b47d-ab83b27594a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:03.916674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af3cc541-fbb6-4f9a-b47d-ab83b27594a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:04.016796 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-db0d2f03-8256-4469-8703-b730ed233abe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 24595 microversion: 2.20 time: 0.142698 Dec 15 19:05:04.018358 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 151/308] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:03 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 24595 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:05:04.027024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-97960895-c89d-45de-8bad-d16ac5fc2299 req-7772e211-3cd2-4c7a-b35b-b919198d493a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a4a770-fe68-4180-b052-5b7161dd2293", "name": "network-vif-deleted", "tag": "891fcb6e-7400-455c-824c-1bcd8f750785"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:04.030462 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:05:04.030462 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:05:04.051120 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-97960895-c89d-45de-8bad-d16ac5fc2299 req-7772e211-3cd2-4c7a-b35b-b919198d493a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:04.053274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-97960895-c89d-45de-8bad-d16ac5fc2299 req-7772e211-3cd2-4c7a-b35b-b919198d493a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:04.067887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-97960895-c89d-45de-8bad-d16ac5fc2299 req-7772e211-3cd2-4c7a-b35b-b919198d493a service nova] Creating event network-vif-deleted:891fcb6e-7400-455c-824c-1bcd8f750785 for instance 11a4a770-fe68-4180-b052-5b7161dd2293 on hv-cinder-81268 Dec 15 19:05:04.073178 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-97960895-c89d-45de-8bad-d16ac5fc2299 req-7772e211-3cd2-4c7a-b35b-b919198d493a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053089 Dec 15 19:05:04.074321 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 152/309] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:05:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:05:04.210670 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-af3cc541-fbb6-4f9a-b47d-ab83b27594a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:04.218494 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-af3cc541-fbb6-4f9a-b47d-ab83b27594a1 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.321737 Dec 15 19:05:04.229484 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 158/310] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:03 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:04.265638 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f8c38ce7-a65b-413c-9638-79940754bf64 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:04.267265 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f8c38ce7-a65b-413c-9638-79940754bf64 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:04.273058 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f8c38ce7-a65b-413c-9638-79940754bf64 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:04.273607 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f8c38ce7-a65b-413c-9638-79940754bf64 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:04.274389 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f8c38ce7-a65b-413c-9638-79940754bf64 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:04.274823 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f8c38ce7-a65b-413c-9638-79940754bf64 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:04.342306 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f8c38ce7-a65b-413c-9638-79940754bf64 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:04.352201 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f8c38ce7-a65b-413c-9638-79940754bf64 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1344 microversion: 2.1 time: 0.090966 Dec 15 19:05:04.361526 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 153/311] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:04 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:04.535775 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-57c87b6b-6c97-4e04-a924-29988c18f4f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:04.536557 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-57c87b6b-6c97-4e04-a924-29988c18f4f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:04.542651 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-57c87b6b-6c97-4e04-a924-29988c18f4f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:04.547795 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-57c87b6b-6c97-4e04-a924-29988c18f4f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:04.547795 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-57c87b6b-6c97-4e04-a924-29988c18f4f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:04.547795 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-57c87b6b-6c97-4e04-a924-29988c18f4f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:04.677348 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-57c87b6b-6c97-4e04-a924-29988c18f4f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:04.684648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-57c87b6b-6c97-4e04-a924-29988c18f4f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.152646 Dec 15 19:05:04.685230 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 159/312] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:04 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:05.029511 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0f56319b-2941-424b-bbf1-c7ea7966ec7b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:05.030472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0f56319b-2941-424b-bbf1-c7ea7966ec7b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:05.037441 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0f56319b-2941-424b-bbf1-c7ea7966ec7b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:05.037886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0f56319b-2941-424b-bbf1-c7ea7966ec7b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:05.038692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0f56319b-2941-424b-bbf1-c7ea7966ec7b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:05.039126 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0f56319b-2941-424b-bbf1-c7ea7966ec7b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:05.235759 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9cc23e44-474d-491e-a960-049e55e643fe tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:05.236376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9cc23e44-474d-491e-a960-049e55e643fe tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:05.242325 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cc23e44-474d-491e-a960-049e55e643fe tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:05.248333 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cc23e44-474d-491e-a960-049e55e643fe tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:05.248333 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cc23e44-474d-491e-a960-049e55e643fe tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:05.248333 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cc23e44-474d-491e-a960-049e55e643fe tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:05.377074 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9cc23e44-474d-491e-a960-049e55e643fe tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:05.384840 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9cc23e44-474d-491e-a960-049e55e643fe tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.153205 Dec 15 19:05:05.385747 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 160/313] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:05 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:05.389901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-69a23fa5-bdd1-4a79-a063-2fa062688cb1 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:05.390596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-69a23fa5-bdd1-4a79-a063-2fa062688cb1 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:05.396749 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-69a23fa5-bdd1-4a79-a063-2fa062688cb1 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:05.397225 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-69a23fa5-bdd1-4a79-a063-2fa062688cb1 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:05.399081 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-69a23fa5-bdd1-4a79-a063-2fa062688cb1 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:05.399081 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-69a23fa5-bdd1-4a79-a063-2fa062688cb1 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:05.462241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-69a23fa5-bdd1-4a79-a063-2fa062688cb1 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:05.470727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-69a23fa5-bdd1-4a79-a063-2fa062688cb1 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1344 microversion: 2.1 time: 0.084146 Dec 15 19:05:05.471385 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 161/314] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:05 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1344 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:05.701718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8c11a311-4e77-4b47-8b70-3c6a5c8f9a34 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:05.702332 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8c11a311-4e77-4b47-8b70-3c6a5c8f9a34 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:05.708472 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c11a311-4e77-4b47-8b70-3c6a5c8f9a34 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:05.711976 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c11a311-4e77-4b47-8b70-3c6a5c8f9a34 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:05.711976 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c11a311-4e77-4b47-8b70-3c6a5c8f9a34 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:05.711976 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c11a311-4e77-4b47-8b70-3c6a5c8f9a34 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:05.838596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8c11a311-4e77-4b47-8b70-3c6a5c8f9a34 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:05.845867 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8c11a311-4e77-4b47-8b70-3c6a5c8f9a34 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.147723 Dec 15 19:05:05.846436 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 162/315] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:05 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:06.261362 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-17a94d1e-bc7d-415a-b786-68c34368f3ff req-bb1f35d7-a8b9-4eb9-a5ad-e9e738c4728c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094752c1-e6f8-47d3-b40b-b20e8e8c12e6", "name": "network-vif-plugged", "status": "completed", "tag": "b3a88158-4982-4b94-94f5-9d2a3ecf2eb1"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:06.263449 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:05:06.263449 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:05:06.271453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-17a94d1e-bc7d-415a-b786-68c34368f3ff req-bb1f35d7-a8b9-4eb9-a5ad-e9e738c4728c service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:06.271961 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-17a94d1e-bc7d-415a-b786-68c34368f3ff req-bb1f35d7-a8b9-4eb9-a5ad-e9e738c4728c service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:06.283211 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-17a94d1e-bc7d-415a-b786-68c34368f3ff req-bb1f35d7-a8b9-4eb9-a5ad-e9e738c4728c service nova] Creating event network-vif-plugged:b3a88158-4982-4b94-94f5-9d2a3ecf2eb1 for instance 094752c1-e6f8-47d3-b40b-b20e8e8c12e6 on hv-cinder-81268 Dec 15 19:05:06.288295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-17a94d1e-bc7d-415a-b786-68c34368f3ff req-bb1f35d7-a8b9-4eb9-a5ad-e9e738c4728c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034054 Dec 15 19:05:06.288873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 163/316] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:05:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:05:06.403136 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b1d59826-bdd0-4aef-abc2-b4b073d93868 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:06.405198 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b1d59826-bdd0-4aef-abc2-b4b073d93868 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:06.411142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b1d59826-bdd0-4aef-abc2-b4b073d93868 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:06.411954 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b1d59826-bdd0-4aef-abc2-b4b073d93868 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:06.412768 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b1d59826-bdd0-4aef-abc2-b4b073d93868 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:06.413281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b1d59826-bdd0-4aef-abc2-b4b073d93868 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:06.577812 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b1d59826-bdd0-4aef-abc2-b4b073d93868 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:06.577812 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b1d59826-bdd0-4aef-abc2-b4b073d93868 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.177901 Dec 15 19:05:06.578838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 164/317] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:06 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:06.583971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c5df75a5-2d5e-4e75-b2ca-fabd2cdc0032 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:06.584898 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c5df75a5-2d5e-4e75-b2ca-fabd2cdc0032 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:06.590902 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5df75a5-2d5e-4e75-b2ca-fabd2cdc0032 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:06.591442 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5df75a5-2d5e-4e75-b2ca-fabd2cdc0032 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:06.592311 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5df75a5-2d5e-4e75-b2ca-fabd2cdc0032 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:06.592939 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5df75a5-2d5e-4e75-b2ca-fabd2cdc0032 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:06.653662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c5df75a5-2d5e-4e75-b2ca-fabd2cdc0032 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:06.662077 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c5df75a5-2d5e-4e75-b2ca-fabd2cdc0032 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1344 microversion: 2.1 time: 0.082020 Dec 15 19:05:06.662632 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 165/318] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:06 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:06.862930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5f49604a-0d19-473b-8077-bb44c804da41 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:06.863663 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5f49604a-0d19-473b-8077-bb44c804da41 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:06.869450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f49604a-0d19-473b-8077-bb44c804da41 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:06.869899 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f49604a-0d19-473b-8077-bb44c804da41 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:06.870678 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f49604a-0d19-473b-8077-bb44c804da41 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:06.871113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f49604a-0d19-473b-8077-bb44c804da41 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:07.000146 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5f49604a-0d19-473b-8077-bb44c804da41 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:07.007392 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5f49604a-0d19-473b-8077-bb44c804da41 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.148200 Dec 15 19:05:07.008202 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 166/319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:06 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:07.202741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0f56319b-2941-424b-bbf1-c7ea7966ec7b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 26026 microversion: 2.20 time: 2.176710 Dec 15 19:05:07.204392 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 154/320] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:05 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 26026 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:07.593998 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-93841d2e-2f2b-44bb-a31e-769e24f30709 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:07.594669 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-93841d2e-2f2b-44bb-a31e-769e24f30709 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:07.601178 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-93841d2e-2f2b-44bb-a31e-769e24f30709 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:07.601644 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-93841d2e-2f2b-44bb-a31e-769e24f30709 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:07.602561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-93841d2e-2f2b-44bb-a31e-769e24f30709 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:07.603213 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-93841d2e-2f2b-44bb-a31e-769e24f30709 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:07.679205 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-293811bb-2413-49ef-ac87-a9f2aea436fa tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:07.679887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-293811bb-2413-49ef-ac87-a9f2aea436fa tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:07.697163 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-293811bb-2413-49ef-ac87-a9f2aea436fa tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:07.697642 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-293811bb-2413-49ef-ac87-a9f2aea436fa tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:07.698449 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-293811bb-2413-49ef-ac87-a9f2aea436fa tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:07.698897 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-293811bb-2413-49ef-ac87-a9f2aea436fa tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:07.755082 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-93841d2e-2f2b-44bb-a31e-769e24f30709 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:07.762847 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-293811bb-2413-49ef-ac87-a9f2aea436fa tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:07.766084 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-93841d2e-2f2b-44bb-a31e-769e24f30709 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.175694 Dec 15 19:05:07.767231 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 167/321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:07 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:07.771494 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-293811bb-2413-49ef-ac87-a9f2aea436fa tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1344 microversion: 2.1 time: 0.096208 Dec 15 19:05:07.772140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 155/322] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:07 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:08.026334 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-43b13e84-efe9-4488-91d2-3085400ff1f0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:08.032565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-43b13e84-efe9-4488-91d2-3085400ff1f0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:08.044701 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-43b13e84-efe9-4488-91d2-3085400ff1f0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.046274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1619849080", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "networks": [{"uuid": "3bd0072d-daf7-4158-a223-046c35eb85a7"}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:08.048303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-43b13e84-efe9-4488-91d2-3085400ff1f0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.049715 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-43b13e84-efe9-4488-91d2-3085400ff1f0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.050238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-43b13e84-efe9-4488-91d2-3085400ff1f0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.106334 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] validate_networks() for [('3bd0072d-daf7-4158-a223-046c35eb85a7', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:05:08.194944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-43b13e84-efe9-4488-91d2-3085400ff1f0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:08.202247 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-43b13e84-efe9-4488-91d2-3085400ff1f0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.179578 Dec 15 19:05:08.203028 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 168/323] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:08 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:08.216399 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f41df1f1-da2e-4c99-8f1d-025047b65db4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:08.217381 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f41df1f1-da2e-4c99-8f1d-025047b65db4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:08.223860 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f41df1f1-da2e-4c99-8f1d-025047b65db4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.224313 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f41df1f1-da2e-4c99-8f1d-025047b65db4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.225125 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f41df1f1-da2e-4c99-8f1d-025047b65db4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.225695 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f41df1f1-da2e-4c99-8f1d-025047b65db4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.312971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f41df1f1-da2e-4c99-8f1d-025047b65db4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 26725 microversion: 2.20 time: 0.099940 Dec 15 19:05:08.313841 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 169/324] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:08 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 26725 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:08.462410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:05:08.462909 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:05:08.463282 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:05:08.463687 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:05:08.464094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:05:08.474227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.474227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.475109 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.475560 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.491986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Getting quotas for project 87416d9f16b34ae393890d3c16f8d55e. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:05:08.496049 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Getting quotas for user 9ad522630b4d4880b6e0e7b897a0a08d and project 87416d9f16b34ae393890d3c16f8d55e. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:05:08.507159 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:05:08.510009 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:05:08.697788 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-de4ab279-0359-4fb5-8116-185454591337 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655375 Dec 15 19:05:08.698704 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 156/325] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:05:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:05:08.709357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-27518e15-5dd2-4ba6-a067-5a65c05e08aa tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:08.710214 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-27518e15-5dd2-4ba6-a067-5a65c05e08aa tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:08.765232 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-27518e15-5dd2-4ba6-a067-5a65c05e08aa tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:08.772206 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-27518e15-5dd2-4ba6-a067-5a65c05e08aa tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1219 microversion: 2.1 time: 0.066880 Dec 15 19:05:08.772761 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 170/326] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:08 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:08.783277 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-801e74f1-01ce-45e6-98d3-132ba98ab964 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:08.783901 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-801e74f1-01ce-45e6-98d3-132ba98ab964 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:08.791589 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:08.791922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-801e74f1-01ce-45e6-98d3-132ba98ab964 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.792197 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:08.792364 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-801e74f1-01ce-45e6-98d3-132ba98ab964 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.793674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-801e74f1-01ce-45e6-98d3-132ba98ab964 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.794274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-801e74f1-01ce-45e6-98d3-132ba98ab964 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.801593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.801593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.801593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.801593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.840351 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:08.840801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:08.841516 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lazy-loading 'fault' on Instance uuid 11a4a770-fe68-4180-b052-5b7161dd2293 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:05:08.902471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31395cc63a4d4901bf539ca266541c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd219be39d8e34b20aaff02dceb7ea34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:08.913592 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0282fbbe-f623-4693-b29b-b0469498c00b tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 200 len: 1349 microversion: 2.1 time: 0.125491 Dec 15 19:05:08.914409 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 171/327] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:08 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 1349 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:08.989308 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-801e74f1-01ce-45e6-98d3-132ba98ab964 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:08.990999 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-801e74f1-01ce-45e6-98d3-132ba98ab964 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.211670 Dec 15 19:05:08.991569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 157/328] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:08 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:09.218507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-134e8923-d920-45db-bbaa-0d278049fe0c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:09.219232 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-134e8923-d920-45db-bbaa-0d278049fe0c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:09.226053 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-134e8923-d920-45db-bbaa-0d278049fe0c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:09.226504 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-134e8923-d920-45db-bbaa-0d278049fe0c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:09.227296 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-134e8923-d920-45db-bbaa-0d278049fe0c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:09.227737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-134e8923-d920-45db-bbaa-0d278049fe0c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:09.324207 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2fc828cc-198a-49f4-b809-ae789ed5b8ee tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:09.325311 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2fc828cc-198a-49f4-b809-ae789ed5b8ee tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:09.331391 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2fc828cc-198a-49f4-b809-ae789ed5b8ee tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:09.334423 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2fc828cc-198a-49f4-b809-ae789ed5b8ee tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:09.334423 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2fc828cc-198a-49f4-b809-ae789ed5b8ee tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:09.334423 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2fc828cc-198a-49f4-b809-ae789ed5b8ee tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:09.358206 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-134e8923-d920-45db-bbaa-0d278049fe0c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:09.366694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-134e8923-d920-45db-bbaa-0d278049fe0c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.151880 Dec 15 19:05:09.367266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 172/329] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:09 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:09.789589 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1ccfa5d4-a7cf-479b-b0c0-27d5a891ac4b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:09.790254 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1ccfa5d4-a7cf-479b-b0c0-27d5a891ac4b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:09.796578 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1ccfa5d4-a7cf-479b-b0c0-27d5a891ac4b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:09.799096 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1ccfa5d4-a7cf-479b-b0c0-27d5a891ac4b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:09.799096 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1ccfa5d4-a7cf-479b-b0c0-27d5a891ac4b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:09.799096 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1ccfa5d4-a7cf-479b-b0c0-27d5a891ac4b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:09.857297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1ccfa5d4-a7cf-479b-b0c0-27d5a891ac4b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:09.864332 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1ccfa5d4-a7cf-479b-b0c0-27d5a891ac4b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1223 microversion: 2.1 time: 0.078785 Dec 15 19:05:09.864900 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 173/330] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:09 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:09.936120 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b5d684d9-4385-4701-a258-6dc36252a198 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:09.936711 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b5d684d9-4385-4701-a258-6dc36252a198 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:09.942269 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b5d684d9-4385-4701-a258-6dc36252a198 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:09.942712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b5d684d9-4385-4701-a258-6dc36252a198 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:09.943478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b5d684d9-4385-4701-a258-6dc36252a198 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:09.943904 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b5d684d9-4385-4701-a258-6dc36252a198 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:09.956831 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-b5d684d9-4385-4701-a258-6dc36252a198 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] HTTP exception thrown: Instance 11a4a770-fe68-4180-b052-5b7161dd2293 could not be found. Dec 15 19:05:09.957424 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b5d684d9-4385-4701-a258-6dc36252a198 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Returning 404 to user: Instance 11a4a770-fe68-4180-b052-5b7161dd2293 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:05:09.958206 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b5d684d9-4385-4701-a258-6dc36252a198 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 404 len: 111 microversion: 2.1 time: 0.025522 Dec 15 19:05:09.958701 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 174/331] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:09 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 19:05:10.008660 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9535b26c-f6ff-43db-98fd-b6cea3dc94f7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:10.009322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9535b26c-f6ff-43db-98fd-b6cea3dc94f7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:10.015083 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9535b26c-f6ff-43db-98fd-b6cea3dc94f7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:10.015526 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9535b26c-f6ff-43db-98fd-b6cea3dc94f7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:10.016800 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9535b26c-f6ff-43db-98fd-b6cea3dc94f7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:10.017254 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9535b26c-f6ff-43db-98fd-b6cea3dc94f7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:10.145962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9535b26c-f6ff-43db-98fd-b6cea3dc94f7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:10.153442 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9535b26c-f6ff-43db-98fd-b6cea3dc94f7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.149197 Dec 15 19:05:10.153995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 175/332] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:10 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:10.159000 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4afb884e-f299-42da-911c-caf2a60c58b8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:10.159962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4afb884e-f299-42da-911c-caf2a60c58b8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:10.165904 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4afb884e-f299-42da-911c-caf2a60c58b8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:10.166400 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4afb884e-f299-42da-911c-caf2a60c58b8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:10.167184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4afb884e-f299-42da-911c-caf2a60c58b8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:10.167679 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4afb884e-f299-42da-911c-caf2a60c58b8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:10.180851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-4afb884e-f299-42da-911c-caf2a60c58b8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] HTTP exception thrown: Instance 11a4a770-fe68-4180-b052-5b7161dd2293 could not be found. Dec 15 19:05:10.181597 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4afb884e-f299-42da-911c-caf2a60c58b8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Returning 404 to user: Instance 11a4a770-fe68-4180-b052-5b7161dd2293 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:05:10.182426 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4afb884e-f299-42da-911c-caf2a60c58b8 tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027544 Dec 15 19:05:10.183119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 176/333] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:05:10 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:05:10.384203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6259ddcb-c740-4e9e-8f6c-4619194105e3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:10.384765 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6259ddcb-c740-4e9e-8f6c-4619194105e3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:10.391709 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6259ddcb-c740-4e9e-8f6c-4619194105e3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:10.392158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6259ddcb-c740-4e9e-8f6c-4619194105e3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:10.392970 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6259ddcb-c740-4e9e-8f6c-4619194105e3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:10.393432 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6259ddcb-c740-4e9e-8f6c-4619194105e3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:10.525635 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6259ddcb-c740-4e9e-8f6c-4619194105e3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:10.533034 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6259ddcb-c740-4e9e-8f6c-4619194105e3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.152851 Dec 15 19:05:10.533700 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 177/334] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:10 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:10.880593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8bff3df9-46a6-4f01-b58e-09706883160b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:10.881235 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8bff3df9-46a6-4f01-b58e-09706883160b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:10.887407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8bff3df9-46a6-4f01-b58e-09706883160b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:10.890641 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8bff3df9-46a6-4f01-b58e-09706883160b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:10.890641 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8bff3df9-46a6-4f01-b58e-09706883160b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:10.890641 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8bff3df9-46a6-4f01-b58e-09706883160b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:10.946555 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8bff3df9-46a6-4f01-b58e-09706883160b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:10.953664 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8bff3df9-46a6-4f01-b58e-09706883160b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1223 microversion: 2.1 time: 0.076683 Dec 15 19:05:10.954225 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 178/335] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:10 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1223 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:11.171455 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-907a0815-c4d5-4973-b1d9-6c9c4f866fe9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:11.172574 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-907a0815-c4d5-4973-b1d9-6c9c4f866fe9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:11.178450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-907a0815-c4d5-4973-b1d9-6c9c4f866fe9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:11.178897 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-907a0815-c4d5-4973-b1d9-6c9c4f866fe9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:11.179664 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-907a0815-c4d5-4973-b1d9-6c9c4f866fe9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:11.180096 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-907a0815-c4d5-4973-b1d9-6c9c4f866fe9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:11.310311 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-907a0815-c4d5-4973-b1d9-6c9c4f866fe9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:11.317390 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-907a0815-c4d5-4973-b1d9-6c9c4f866fe9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1317 microversion: 2.1 time: 0.149709 Dec 15 19:05:11.317950 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 179/336] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:11 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:11.549563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-82b31aeb-87e7-432b-a2bd-67cd8039cc61 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:11.550177 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-82b31aeb-87e7-432b-a2bd-67cd8039cc61 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:11.556279 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-82b31aeb-87e7-432b-a2bd-67cd8039cc61 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:11.556729 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-82b31aeb-87e7-432b-a2bd-67cd8039cc61 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:11.557530 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-82b31aeb-87e7-432b-a2bd-67cd8039cc61 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:11.557963 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-82b31aeb-87e7-432b-a2bd-67cd8039cc61 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:11.689199 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-82b31aeb-87e7-432b-a2bd-67cd8039cc61 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:11.696364 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-82b31aeb-87e7-432b-a2bd-67cd8039cc61 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.150361 Dec 15 19:05:11.697013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 180/337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:11 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:11.970814 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-76e7acfa-0418-498a-bf82-89e1a4bc3649 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:11.971441 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-76e7acfa-0418-498a-bf82-89e1a4bc3649 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:11.977436 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76e7acfa-0418-498a-bf82-89e1a4bc3649 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:11.977886 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76e7acfa-0418-498a-bf82-89e1a4bc3649 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:11.978667 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76e7acfa-0418-498a-bf82-89e1a4bc3649 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:11.979101 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76e7acfa-0418-498a-bf82-89e1a4bc3649 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:11.994231 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2fc828cc-198a-49f4-b809-ae789ed5b8ee tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 27842 microversion: 2.20 time: 2.673495 Dec 15 19:05:11.995303 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 158/338] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:09 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 27842 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:05:12.041929 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-76e7acfa-0418-498a-bf82-89e1a4bc3649 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:12.049393 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-76e7acfa-0418-498a-bf82-89e1a4bc3649 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1223 microversion: 2.1 time: 0.082604 Dec 15 19:05:12.050348 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 181/339] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:11 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:12.334465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-48017198-522c-48f5-bbc9-e8d5dbf2b5d4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:12.335164 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-48017198-522c-48f5-bbc9-e8d5dbf2b5d4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:12.342038 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-48017198-522c-48f5-bbc9-e8d5dbf2b5d4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:12.345740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-48017198-522c-48f5-bbc9-e8d5dbf2b5d4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:12.345740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-48017198-522c-48f5-bbc9-e8d5dbf2b5d4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:12.345740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-48017198-522c-48f5-bbc9-e8d5dbf2b5d4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:12.473169 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-48017198-522c-48f5-bbc9-e8d5dbf2b5d4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:12.481023 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-48017198-522c-48f5-bbc9-e8d5dbf2b5d4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1507 microversion: 2.1 time: 0.150551 Dec 15 19:05:12.481666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 159/340] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:12 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:12.501769 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3d23c6db-cdfe-4f7a-b933-b521e11b1e7e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63cf922e-0292-4b36-b46c-7337b47e9566"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:12.502767 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3d23c6db-cdfe-4f7a-b933-b521e11b1e7e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:12.508782 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d23c6db-cdfe-4f7a-b933-b521e11b1e7e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:12.509279 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d23c6db-cdfe-4f7a-b933-b521e11b1e7e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:12.510063 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d23c6db-cdfe-4f7a-b933-b521e11b1e7e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:12.510500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d23c6db-cdfe-4f7a-b933-b521e11b1e7e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:12.588384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-3d23c6db-cdfe-4f7a-b933-b521e11b1e7e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] HTTP exception thrown: Invalid volume: volume 63cf922e-0292-4b36-b46c-7337b47e9566 is already attached to instances: 0314d560-94f2-4a77-a4ba-e572c16baf83 Dec 15 19:05:12.589000 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3d23c6db-cdfe-4f7a-b933-b521e11b1e7e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Returning 400 to user: Invalid volume: volume 63cf922e-0292-4b36-b46c-7337b47e9566 is already attached to instances: 0314d560-94f2-4a77-a4ba-e572c16baf83 {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:05:12.589860 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3d23c6db-cdfe-4f7a-b933-b521e11b1e7e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "POST /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092281 Dec 15 19:05:12.590589 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 182/341] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:05:12 2021] POST /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 19:05:12.667530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-87bae088-68ba-4550-8ba0-2334ccdb6403 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:12.668070 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-87bae088-68ba-4550-8ba0-2334ccdb6403 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:12.674755 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87bae088-68ba-4550-8ba0-2334ccdb6403 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:12.675055 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87bae088-68ba-4550-8ba0-2334ccdb6403 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:12.675836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87bae088-68ba-4550-8ba0-2334ccdb6403 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:12.676272 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87bae088-68ba-4550-8ba0-2334ccdb6403 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:12.714182 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-68e98ef6-bfd6-4f8b-bed2-9d11d7ad0764 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:12.715004 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-68e98ef6-bfd6-4f8b-bed2-9d11d7ad0764 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:12.724488 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-68e98ef6-bfd6-4f8b-bed2-9d11d7ad0764 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:12.725219 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-68e98ef6-bfd6-4f8b-bed2-9d11d7ad0764 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:12.726078 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-68e98ef6-bfd6-4f8b-bed2-9d11d7ad0764 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:12.726522 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-68e98ef6-bfd6-4f8b-bed2-9d11d7ad0764 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:12.867688 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-68e98ef6-bfd6-4f8b-bed2-9d11d7ad0764 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:12.875049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-68e98ef6-bfd6-4f8b-bed2-9d11d7ad0764 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.164572 Dec 15 19:05:12.875609 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 183/342] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:12 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:13.013541 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fcf45692-50f4-4df6-9ddb-5e90a4188257 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:13.014722 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fcf45692-50f4-4df6-9ddb-5e90a4188257 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:13.022809 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcf45692-50f4-4df6-9ddb-5e90a4188257 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.023351 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcf45692-50f4-4df6-9ddb-5e90a4188257 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.024328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcf45692-50f4-4df6-9ddb-5e90a4188257 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.025060 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcf45692-50f4-4df6-9ddb-5e90a4188257 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.027674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-87bae088-68ba-4550-8ba0-2334ccdb6403 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lazy-loading 'services' on Instance uuid 0314d560-94f2-4a77-a4ba-e572c16baf83 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:05:13.134284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fcf45692-50f4-4df6-9ddb-5e90a4188257 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 28204 microversion: 2.20 time: 0.129826 Dec 15 19:05:13.138531 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 184/343] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:13 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 28204 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:13.141556 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c016d783-96cb-4279-9205-efe533fa91fe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:13.141556 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c016d783-96cb-4279-9205-efe533fa91fe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:13.147986 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c016d783-96cb-4279-9205-efe533fa91fe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.148432 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c016d783-96cb-4279-9205-efe533fa91fe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.149255 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c016d783-96cb-4279-9205-efe533fa91fe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.149689 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c016d783-96cb-4279-9205-efe533fa91fe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.227448 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c016d783-96cb-4279-9205-efe533fa91fe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:13.234876 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c016d783-96cb-4279-9205-efe533fa91fe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1271 microversion: 2.1 time: 0.098837 Dec 15 19:05:13.238653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 185/344] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:13 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:13.300769 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-87bae088-68ba-4550-8ba0-2334ccdb6403 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments/63cf922e-0292-4b36-b46c-7337b47e9566" status: 202 len: 0 microversion: 2.1 time: 0.636857 Dec 15 19:05:13.302519 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 160/345] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:05:12 2021] DELETE /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments/63cf922e-0292-4b36-b46c-7337b47e9566 => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:13.309968 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8083ce94-693e-412f-8970-f4d520921d1e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:13.311029 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8083ce94-693e-412f-8970-f4d520921d1e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:13.317743 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8083ce94-693e-412f-8970-f4d520921d1e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.318195 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8083ce94-693e-412f-8970-f4d520921d1e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.319029 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8083ce94-693e-412f-8970-f4d520921d1e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.319428 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8083ce94-693e-412f-8970-f4d520921d1e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.363514 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8083ce94-693e-412f-8970-f4d520921d1e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055991 Dec 15 19:05:13.363514 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 186/346] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:05:13 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:05:13.648752 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-aff82f0e-c303-425a-bcbd-6a815145dc4e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:13.649419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-aff82f0e-c303-425a-bcbd-6a815145dc4e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:13.656022 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aff82f0e-c303-425a-bcbd-6a815145dc4e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.656492 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aff82f0e-c303-425a-bcbd-6a815145dc4e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.657384 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aff82f0e-c303-425a-bcbd-6a815145dc4e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.657810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aff82f0e-c303-425a-bcbd-6a815145dc4e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.670745 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-aff82f0e-c303-425a-bcbd-6a815145dc4e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] HTTP exception thrown: Instance 11a4a770-fe68-4180-b052-5b7161dd2293 could not be found. Dec 15 19:05:13.673804 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-aff82f0e-c303-425a-bcbd-6a815145dc4e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Returning 404 to user: Instance 11a4a770-fe68-4180-b052-5b7161dd2293 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:05:13.673804 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-aff82f0e-c303-425a-bcbd-6a815145dc4e tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "DELETE /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 404 len: 111 microversion: 2.1 time: 0.027958 Dec 15 19:05:13.673804 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 161/347] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:05:13 2021] DELETE /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:05:13.680939 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d7bfbbf7-5981-46a4-8b52-7c2f8603997d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:13.681768 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d7bfbbf7-5981-46a4-8b52-7c2f8603997d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] [instance: 11a4a770-fe68-4180-b052-5b7161dd2293] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:13.688746 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d7bfbbf7-5981-46a4-8b52-7c2f8603997d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.689503 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d7bfbbf7-5981-46a4-8b52-7c2f8603997d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.692114 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d7bfbbf7-5981-46a4-8b52-7c2f8603997d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.692635 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d7bfbbf7-5981-46a4-8b52-7c2f8603997d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.706244 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-d7bfbbf7-5981-46a4-8b52-7c2f8603997d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] HTTP exception thrown: Instance 11a4a770-fe68-4180-b052-5b7161dd2293 could not be found. Dec 15 19:05:13.706916 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d7bfbbf7-5981-46a4-8b52-7c2f8603997d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] Returning 404 to user: Instance 11a4a770-fe68-4180-b052-5b7161dd2293 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:05:13.707841 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d7bfbbf7-5981-46a4-8b52-7c2f8603997d tempest-DeleteServersTestJSON-242899356 tempest-DeleteServersTestJSON-242899356-project] 10.222.0.49 "GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293" status: 404 len: 111 microversion: 2.1 time: 0.030639 Dec 15 19:05:13.708379 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 187/348] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:13 2021] GET /compute/v2.1/servers/11a4a770-fe68-4180-b052-5b7161dd2293 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:05:13.891435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b1fa0517-7d59-481e-824d-1a58c0e56ac0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:13.892050 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b1fa0517-7d59-481e-824d-1a58c0e56ac0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:13.898052 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b1fa0517-7d59-481e-824d-1a58c0e56ac0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.898505 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b1fa0517-7d59-481e-824d-1a58c0e56ac0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:13.899468 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b1fa0517-7d59-481e-824d-1a58c0e56ac0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:13.899909 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b1fa0517-7d59-481e-824d-1a58c0e56ac0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:14.102458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b1fa0517-7d59-481e-824d-1a58c0e56ac0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:14.110669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b1fa0517-7d59-481e-824d-1a58c0e56ac0 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.222873 Dec 15 19:05:14.112364 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 162/349] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:13 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:14.145678 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1c348a01-ae57-42b8-874a-4bb6555b9797 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:14.146654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1c348a01-ae57-42b8-874a-4bb6555b9797 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:14.153228 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1c348a01-ae57-42b8-874a-4bb6555b9797 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:14.153683 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1c348a01-ae57-42b8-874a-4bb6555b9797 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:14.154472 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1c348a01-ae57-42b8-874a-4bb6555b9797 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:14.154909 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1c348a01-ae57-42b8-874a-4bb6555b9797 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:14.260784 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d713bad3-94d2-411e-bee5-46a2ae68e44d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:14.261736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d713bad3-94d2-411e-bee5-46a2ae68e44d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:14.268461 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d713bad3-94d2-411e-bee5-46a2ae68e44d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:14.268903 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d713bad3-94d2-411e-bee5-46a2ae68e44d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:14.269711 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d713bad3-94d2-411e-bee5-46a2ae68e44d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:14.270213 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d713bad3-94d2-411e-bee5-46a2ae68e44d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:14.400494 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d713bad3-94d2-411e-bee5-46a2ae68e44d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:14.408171 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d713bad3-94d2-411e-bee5-46a2ae68e44d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.160332 Dec 15 19:05:14.408726 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 163/350] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:14 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:14.413003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f9b7a7a7-3033-48c8-9e75-d9bd74e84ae2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:14.414139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f9b7a7a7-3033-48c8-9e75-d9bd74e84ae2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:14.422349 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f9b7a7a7-3033-48c8-9e75-d9bd74e84ae2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:14.426537 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f9b7a7a7-3033-48c8-9e75-d9bd74e84ae2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:14.426537 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f9b7a7a7-3033-48c8-9e75-d9bd74e84ae2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:14.426537 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f9b7a7a7-3033-48c8-9e75-d9bd74e84ae2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:14.453341 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f9b7a7a7-3033-48c8-9e75-d9bd74e84ae2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Dec 15 19:05:14.454127 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 164/351] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:05:14 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:05:15.128624 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-17a4c7ac-89cf-487f-8c12-4b0913d2d127 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:15.129241 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-17a4c7ac-89cf-487f-8c12-4b0913d2d127 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:15.135528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17a4c7ac-89cf-487f-8c12-4b0913d2d127 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:15.135983 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17a4c7ac-89cf-487f-8c12-4b0913d2d127 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:15.136737 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17a4c7ac-89cf-487f-8c12-4b0913d2d127 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:15.137196 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17a4c7ac-89cf-487f-8c12-4b0913d2d127 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:15.284060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-17a4c7ac-89cf-487f-8c12-4b0913d2d127 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:15.291336 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-17a4c7ac-89cf-487f-8c12-4b0913d2d127 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.166897 Dec 15 19:05:15.291924 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 165/352] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:15 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:15.425801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0301491b-7a4f-4b40-8625-67edb5c030df tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:15.426407 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0301491b-7a4f-4b40-8625-67edb5c030df tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:15.432089 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0301491b-7a4f-4b40-8625-67edb5c030df tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:15.432538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0301491b-7a4f-4b40-8625-67edb5c030df tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:15.433347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0301491b-7a4f-4b40-8625-67edb5c030df tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:15.433784 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0301491b-7a4f-4b40-8625-67edb5c030df tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:15.564128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0301491b-7a4f-4b40-8625-67edb5c030df tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:15.571393 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0301491b-7a4f-4b40-8625-67edb5c030df tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.149949 Dec 15 19:05:15.572519 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 166/353] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:15 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:15.576271 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fbb5996f-4e23-484e-a2d8-91817d8a3a2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:15.577193 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fbb5996f-4e23-484e-a2d8-91817d8a3a2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:15.582693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fbb5996f-4e23-484e-a2d8-91817d8a3a2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:15.583143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fbb5996f-4e23-484e-a2d8-91817d8a3a2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:15.583927 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fbb5996f-4e23-484e-a2d8-91817d8a3a2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:15.584359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fbb5996f-4e23-484e-a2d8-91817d8a3a2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:15.614018 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fbb5996f-4e23-484e-a2d8-91817d8a3a2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041065 Dec 15 19:05:15.614840 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 167/354] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:05:15 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:05:16.307866 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3f5eaf4e-5c02-47a1-99a2-524beed72b15 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:16.312826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3f5eaf4e-5c02-47a1-99a2-524beed72b15 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:16.315521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3f5eaf4e-5c02-47a1-99a2-524beed72b15 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:16.316036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3f5eaf4e-5c02-47a1-99a2-524beed72b15 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:16.316831 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3f5eaf4e-5c02-47a1-99a2-524beed72b15 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:16.317305 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3f5eaf4e-5c02-47a1-99a2-524beed72b15 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:16.445225 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3f5eaf4e-5c02-47a1-99a2-524beed72b15 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:16.452507 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3f5eaf4e-5c02-47a1-99a2-524beed72b15 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.148460 Dec 15 19:05:16.453717 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 168/355] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:16 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:16.542326 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1c348a01-ae57-42b8-874a-4bb6555b9797 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 28204 microversion: 2.20 time: 2.400261 Dec 15 19:05:16.545706 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 188/356] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:14 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 28204 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:16.591614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ec5b6d1e-7c30-4c0e-9cea-445a00ef946c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:16.591614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ec5b6d1e-7c30-4c0e-9cea-445a00ef946c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:16.595102 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec5b6d1e-7c30-4c0e-9cea-445a00ef946c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:16.595551 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec5b6d1e-7c30-4c0e-9cea-445a00ef946c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:16.596844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec5b6d1e-7c30-4c0e-9cea-445a00ef946c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:16.597553 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec5b6d1e-7c30-4c0e-9cea-445a00ef946c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:16.627109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4d05d267-457d-4382-bb05-e2836266666d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:16.628560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4d05d267-457d-4382-bb05-e2836266666d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:16.636289 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4d05d267-457d-4382-bb05-e2836266666d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:16.637591 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4d05d267-457d-4382-bb05-e2836266666d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:16.638255 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4d05d267-457d-4382-bb05-e2836266666d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:16.638780 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4d05d267-457d-4382-bb05-e2836266666d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:16.676119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4d05d267-457d-4382-bb05-e2836266666d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053809 Dec 15 19:05:16.677010 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 189/357] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:05:16 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:05:16.740495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ec5b6d1e-7c30-4c0e-9cea-445a00ef946c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:16.748243 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ec5b6d1e-7c30-4c0e-9cea-445a00ef946c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.163711 Dec 15 19:05:16.748809 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 169/358] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:16 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:17.470751 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-34dfc19e-5078-4c20-86ac-03124bf034dd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:17.471722 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-34dfc19e-5078-4c20-86ac-03124bf034dd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:17.478703 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-34dfc19e-5078-4c20-86ac-03124bf034dd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:17.479445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-34dfc19e-5078-4c20-86ac-03124bf034dd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:17.480445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-34dfc19e-5078-4c20-86ac-03124bf034dd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:17.481053 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-34dfc19e-5078-4c20-86ac-03124bf034dd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:17.554067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-214ff285-396c-4f9f-9e10-4fc1c852d548 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:17.555763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-214ff285-396c-4f9f-9e10-4fc1c852d548 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:17.561936 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-214ff285-396c-4f9f-9e10-4fc1c852d548 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:17.562420 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-214ff285-396c-4f9f-9e10-4fc1c852d548 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:17.563245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-214ff285-396c-4f9f-9e10-4fc1c852d548 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:17.564356 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-214ff285-396c-4f9f-9e10-4fc1c852d548 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:17.649854 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-214ff285-396c-4f9f-9e10-4fc1c852d548 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 28204 microversion: 2.20 time: 0.099169 Dec 15 19:05:17.656739 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 170/359] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:17 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 28204 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:17.688505 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c686609e-3fa0-44b7-9b49-286f32d89a77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:17.689591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c686609e-3fa0-44b7-9b49-286f32d89a77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:17.697753 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c686609e-3fa0-44b7-9b49-286f32d89a77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:17.698203 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c686609e-3fa0-44b7-9b49-286f32d89a77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:17.698999 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c686609e-3fa0-44b7-9b49-286f32d89a77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:17.699433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c686609e-3fa0-44b7-9b49-286f32d89a77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:17.734540 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c686609e-3fa0-44b7-9b49-286f32d89a77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050294 Dec 15 19:05:17.735470 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 171/360] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:05:17 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:05:17.741972 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-12b7c1d2-36b4-48fc-b1b4-16d45cc9d928 req-10c3e5b7-6694-4bef-9259-51ff9c03654b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e09c87-53f0-4d48-9eba-d5adae8227e3", "tag": "828144f6-72f4-4245-b754-2f3f975b9c13"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:17.744669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:05:17.744669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:05:17.745510 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-34dfc19e-5078-4c20-86ac-03124bf034dd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:17.752647 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-12b7c1d2-36b4-48fc-b1b4-16d45cc9d928 req-10c3e5b7-6694-4bef-9259-51ff9c03654b service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:17.753346 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-12b7c1d2-36b4-48fc-b1b4-16d45cc9d928 req-10c3e5b7-6694-4bef-9259-51ff9c03654b service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:17.755538 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-34dfc19e-5078-4c20-86ac-03124bf034dd tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.289123 Dec 15 19:05:17.757274 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 190/361] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:17 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:17.768030 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b93d667a-464d-463b-a944-bee59d91cfee tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:17.777044 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b93d667a-464d-463b-a944-bee59d91cfee tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:17.781158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b93d667a-464d-463b-a944-bee59d91cfee tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:17.782247 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b93d667a-464d-463b-a944-bee59d91cfee tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:17.783275 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b93d667a-464d-463b-a944-bee59d91cfee tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:17.783917 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b93d667a-464d-463b-a944-bee59d91cfee tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:17.788578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-12b7c1d2-36b4-48fc-b1b4-16d45cc9d928 req-10c3e5b7-6694-4bef-9259-51ff9c03654b service nova] Creating event network-changed:828144f6-72f4-4245-b754-2f3f975b9c13 for instance 26e09c87-53f0-4d48-9eba-d5adae8227e3 on hv-cinder-81268 Dec 15 19:05:17.793951 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-12b7c1d2-36b4-48fc-b1b4-16d45cc9d928 req-10c3e5b7-6694-4bef-9259-51ff9c03654b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057043 Dec 15 19:05:17.794570 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 172/362] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:05:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:05:18.006706 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b93d667a-464d-463b-a944-bee59d91cfee tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:18.031521 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b93d667a-464d-463b-a944-bee59d91cfee tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.268515 Dec 15 19:05:18.041507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 191/363] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:17 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:18.253004 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-495215128", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "networks": [{"uuid": "9b5341ac-959a-4f9c-b267-56c4cfd3994a"}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:18.336724 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] validate_networks() for [('9b5341ac-959a-4f9c-b267-56c4cfd3994a', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:05:18.662391 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-67b9b9b0-687c-4b29-a59d-9d6669510c66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:18.664024 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-67b9b9b0-687c-4b29-a59d-9d6669510c66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:18.670736 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-67b9b9b0-687c-4b29-a59d-9d6669510c66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:18.671191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-67b9b9b0-687c-4b29-a59d-9d6669510c66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:18.673135 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-67b9b9b0-687c-4b29-a59d-9d6669510c66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:18.673878 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-67b9b9b0-687c-4b29-a59d-9d6669510c66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:18.811151 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-67b9b9b0-687c-4b29-a59d-9d6669510c66 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 28495 microversion: 2.20 time: 0.149508 Dec 15 19:05:18.813302 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 192/364] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:18 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 28495 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:05:18.822978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-66e4542f-e4d6-43b4-9761-10dfdb533e33 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:18.825043 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-66e4542f-e4d6-43b4-9761-10dfdb533e33 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:18.830761 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:05:18.831348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:05:18.831845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:05:18.832350 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:05:18.832864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:05:18.844682 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:18.845436 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:18.846378 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:18.846899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:18.850997 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66e4542f-e4d6-43b4-9761-10dfdb533e33 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:18.851948 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66e4542f-e4d6-43b4-9761-10dfdb533e33 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:18.853183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66e4542f-e4d6-43b4-9761-10dfdb533e33 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:18.854306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-66e4542f-e4d6-43b4-9761-10dfdb533e33 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:18.866039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Getting quotas for project 52e4764fb4d34d5dbdd967080b99c537. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:05:18.870805 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Getting quotas for user d79566c6c23e4944aadc60c1957cff95 and project 52e4764fb4d34d5dbdd967080b99c537. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:05:18.885889 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:05:18.892864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:05:19.006124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4d3afa6b-e251-4c78-bd28-46f80033681b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758175 Dec 15 19:05:19.006812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 173/365] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:05:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:05:19.016864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-35e52d87-8b1d-4e54-8ce7-96a709ed2411 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:19.017811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-35e52d87-8b1d-4e54-8ce7-96a709ed2411 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:19.083291 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-35e52d87-8b1d-4e54-8ce7-96a709ed2411 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:19.092865 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-35e52d87-8b1d-4e54-8ce7-96a709ed2411 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1217 microversion: 2.1 time: 0.079617 Dec 15 19:05:19.104752 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 174/366] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:19 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:19.110609 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9ddd4281-c2c4-42e4-979e-06662b2c9450 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:19.111221 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9ddd4281-c2c4-42e4-979e-06662b2c9450 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:19.118709 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9ddd4281-c2c4-42e4-979e-06662b2c9450 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:19.119588 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9ddd4281-c2c4-42e4-979e-06662b2c9450 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:19.120802 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9ddd4281-c2c4-42e4-979e-06662b2c9450 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:19.121658 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9ddd4281-c2c4-42e4-979e-06662b2c9450 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:19.305151 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9ddd4281-c2c4-42e4-979e-06662b2c9450 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:19.315519 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9ddd4281-c2c4-42e4-979e-06662b2c9450 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.209603 Dec 15 19:05:19.323188 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 175/367] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:19 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:19.323906 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-66e4542f-e4d6-43b4-9761-10dfdb533e33 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:19.335263 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-66e4542f-e4d6-43b4-9761-10dfdb533e33 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.520421 Dec 15 19:05:19.337507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 193/368] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:18 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:19.824825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-791288c1-ed6d-4b39-828d-259a68eb20f9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:19.826965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-791288c1-ed6d-4b39-828d-259a68eb20f9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:19.834777 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-791288c1-ed6d-4b39-828d-259a68eb20f9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:19.836055 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-791288c1-ed6d-4b39-828d-259a68eb20f9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:19.836900 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-791288c1-ed6d-4b39-828d-259a68eb20f9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:19.837359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-791288c1-ed6d-4b39-828d-259a68eb20f9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:19.937137 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-791288c1-ed6d-4b39-828d-259a68eb20f9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 28661 microversion: 2.20 time: 0.116394 Dec 15 19:05:19.937991 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 176/369] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:19 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 28661 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:20.111520 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-81beefc0-7756-48ea-a280-cf18b074ec7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:20.112733 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-81beefc0-7756-48ea-a280-cf18b074ec7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:20.120251 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81beefc0-7756-48ea-a280-cf18b074ec7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:20.121542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81beefc0-7756-48ea-a280-cf18b074ec7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:20.122517 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81beefc0-7756-48ea-a280-cf18b074ec7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:20.122997 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81beefc0-7756-48ea-a280-cf18b074ec7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:20.228143 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-81beefc0-7756-48ea-a280-cf18b074ec7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:20.238653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-81beefc0-7756-48ea-a280-cf18b074ec7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1221 microversion: 2.1 time: 0.130785 Dec 15 19:05:20.239218 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 194/370] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:20 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:20.332801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-88c36f70-0211-4008-b575-e2e0577cbcd1 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:20.333658 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-88c36f70-0211-4008-b575-e2e0577cbcd1 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:20.340594 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-88c36f70-0211-4008-b575-e2e0577cbcd1 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:20.341115 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-88c36f70-0211-4008-b575-e2e0577cbcd1 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:20.342214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-88c36f70-0211-4008-b575-e2e0577cbcd1 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:20.342800 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-88c36f70-0211-4008-b575-e2e0577cbcd1 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:20.354223 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3eb621b3-08e8-4b6c-af6e-bd138757f64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:20.354748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3eb621b3-08e8-4b6c-af6e-bd138757f64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:20.366538 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3eb621b3-08e8-4b6c-af6e-bd138757f64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:20.366999 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3eb621b3-08e8-4b6c-af6e-bd138757f64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:20.367830 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3eb621b3-08e8-4b6c-af6e-bd138757f64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:20.368270 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3eb621b3-08e8-4b6c-af6e-bd138757f64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:20.571101 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-88c36f70-0211-4008-b575-e2e0577cbcd1 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:20.587645 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-88c36f70-0211-4008-b575-e2e0577cbcd1 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.258847 Dec 15 19:05:20.599819 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 177/371] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:20 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:20.648505 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3eb621b3-08e8-4b6c-af6e-bd138757f64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:20.656573 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3eb621b3-08e8-4b6c-af6e-bd138757f64d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.305972 Dec 15 19:05:20.657184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 195/372] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:20 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:20.955175 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4a97e6d9-b479-42b1-ace1-779717cc9c0e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:20.956089 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4a97e6d9-b479-42b1-ace1-779717cc9c0e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:20.962160 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4a97e6d9-b479-42b1-ace1-779717cc9c0e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:20.962819 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4a97e6d9-b479-42b1-ace1-779717cc9c0e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:20.963727 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4a97e6d9-b479-42b1-ace1-779717cc9c0e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:20.964156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4a97e6d9-b479-42b1-ace1-779717cc9c0e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:21.050422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4a97e6d9-b479-42b1-ace1-779717cc9c0e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 28663 microversion: 2.20 time: 0.099646 Dec 15 19:05:21.051210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 178/373] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:20 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 28663 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:21.257198 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-cd8adc37-3732-4f10-8cd9-b432a2ea9e32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:21.258107 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-cd8adc37-3732-4f10-8cd9-b432a2ea9e32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:21.264466 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd8adc37-3732-4f10-8cd9-b432a2ea9e32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:21.265901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd8adc37-3732-4f10-8cd9-b432a2ea9e32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:21.266851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd8adc37-3732-4f10-8cd9-b432a2ea9e32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:21.267511 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd8adc37-3732-4f10-8cd9-b432a2ea9e32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:21.336841 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cd8adc37-3732-4f10-8cd9-b432a2ea9e32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:21.347695 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-cd8adc37-3732-4f10-8cd9-b432a2ea9e32 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1269 microversion: 2.1 time: 0.093860 Dec 15 19:05:21.347695 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 196/374] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:21 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:21.607569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-acd75900-01bd-43ba-a8f1-c08a8b43148b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:21.608298 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-acd75900-01bd-43ba-a8f1-c08a8b43148b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:21.618529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-acd75900-01bd-43ba-a8f1-c08a8b43148b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:21.619287 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-acd75900-01bd-43ba-a8f1-c08a8b43148b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:21.620520 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-acd75900-01bd-43ba-a8f1-c08a8b43148b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:21.621261 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-acd75900-01bd-43ba-a8f1-c08a8b43148b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:21.673921 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f6f864d6-8942-444c-82fd-a7cd874f92af tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:21.674823 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f6f864d6-8942-444c-82fd-a7cd874f92af tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:21.682561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f6f864d6-8942-444c-82fd-a7cd874f92af tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:21.683372 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f6f864d6-8942-444c-82fd-a7cd874f92af tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:21.684342 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f6f864d6-8942-444c-82fd-a7cd874f92af tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:21.685552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f6f864d6-8942-444c-82fd-a7cd874f92af tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:22.049807 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-acd75900-01bd-43ba-a8f1-c08a8b43148b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:22.069702 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-acd75900-01bd-43ba-a8f1-c08a8b43148b tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.467722 Dec 15 19:05:22.079793 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 179/375] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:21 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:22.085380 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ddc1bffb-3c84-4621-a718-c79881313cfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:22.086288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ddc1bffb-3c84-4621-a718-c79881313cfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:22.093552 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ddc1bffb-3c84-4621-a718-c79881313cfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:22.094213 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ddc1bffb-3c84-4621-a718-c79881313cfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:22.095159 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ddc1bffb-3c84-4621-a718-c79881313cfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:22.095763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ddc1bffb-3c84-4621-a718-c79881313cfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:22.183072 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ddc1bffb-3c84-4621-a718-c79881313cfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 28663 microversion: 2.20 time: 0.101334 Dec 15 19:05:22.185596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 180/376] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:22 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 28663 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:22.236338 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f6f864d6-8942-444c-82fd-a7cd874f92af tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:22.260279 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f6f864d6-8942-444c-82fd-a7cd874f92af tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.590792 Dec 15 19:05:22.261822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 197/377] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:21 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:22.368066 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6c68b9fb-9d5f-4873-99b8-05a1850decd4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:22.368760 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6c68b9fb-9d5f-4873-99b8-05a1850decd4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:22.375847 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c68b9fb-9d5f-4873-99b8-05a1850decd4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:22.376499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c68b9fb-9d5f-4873-99b8-05a1850decd4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:22.377498 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c68b9fb-9d5f-4873-99b8-05a1850decd4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:22.378073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c68b9fb-9d5f-4873-99b8-05a1850decd4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:22.470596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6c68b9fb-9d5f-4873-99b8-05a1850decd4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:22.479152 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6c68b9fb-9d5f-4873-99b8-05a1850decd4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1275 microversion: 2.1 time: 0.117670 Dec 15 19:05:22.481517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 181/378] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:22 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:23.107077 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bb26c8b8-62e8-437d-a71f-36d0f957dc53 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:23.108156 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bb26c8b8-62e8-437d-a71f-36d0f957dc53 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:23.119443 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb26c8b8-62e8-437d-a71f-36d0f957dc53 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:23.120062 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb26c8b8-62e8-437d-a71f-36d0f957dc53 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:23.121204 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb26c8b8-62e8-437d-a71f-36d0f957dc53 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:23.121724 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb26c8b8-62e8-437d-a71f-36d0f957dc53 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:23.197811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-89bfccbd-18bc-4002-af12-9e2f08857eb7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:23.202383 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-89bfccbd-18bc-4002-af12-9e2f08857eb7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:23.214602 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89bfccbd-18bc-4002-af12-9e2f08857eb7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:23.215502 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89bfccbd-18bc-4002-af12-9e2f08857eb7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:23.217672 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89bfccbd-18bc-4002-af12-9e2f08857eb7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:23.219861 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89bfccbd-18bc-4002-af12-9e2f08857eb7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:23.394494 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-89bfccbd-18bc-4002-af12-9e2f08857eb7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 28663 microversion: 2.20 time: 0.201114 Dec 15 19:05:23.395508 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 182/379] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:23 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 28663 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:05:23.401839 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9fac50f4-82e2-40f2-9da5-165d044d2742 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:23.403413 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9fac50f4-82e2-40f2-9da5-165d044d2742 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:23.411556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fac50f4-82e2-40f2-9da5-165d044d2742 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:23.412266 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fac50f4-82e2-40f2-9da5-165d044d2742 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:23.413436 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fac50f4-82e2-40f2-9da5-165d044d2742 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:23.414029 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fac50f4-82e2-40f2-9da5-165d044d2742 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:23.545567 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bb26c8b8-62e8-437d-a71f-36d0f957dc53 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:23.561240 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bb26c8b8-62e8-437d-a71f-36d0f957dc53 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.468885 Dec 15 19:05:23.566029 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 198/380] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:23 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:23.575621 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5eea11eb-c391-41c2-8651-35a870d52b07 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:23.578634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5eea11eb-c391-41c2-8651-35a870d52b07 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:23.593113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5eea11eb-c391-41c2-8651-35a870d52b07 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:23.593869 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5eea11eb-c391-41c2-8651-35a870d52b07 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:23.595445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5eea11eb-c391-41c2-8651-35a870d52b07 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:23.596085 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5eea11eb-c391-41c2-8651-35a870d52b07 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:23.799035 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5eea11eb-c391-41c2-8651-35a870d52b07 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:23.808246 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5eea11eb-c391-41c2-8651-35a870d52b07 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.240519 Dec 15 19:05:23.809210 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 199/381] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:23 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:23.836810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9fac50f4-82e2-40f2-9da5-165d044d2742 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:23.845023 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9fac50f4-82e2-40f2-9da5-165d044d2742 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.447970 Dec 15 19:05:23.845627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 183/382] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:23 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:24.303521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-c05b1ace-8597-4552-81c7-20f83c8fa010 req-f59d19e8-fe8d-42bf-91a6-e66282c36cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb865707-c2a0-4a91-9c92-70e29b1b2a48", "tag": "4dcfb7ae-10e1-4733-8e99-a050c9e0f38a"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:24.303521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:05:24.303521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:05:24.310697 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-c05b1ace-8597-4552-81c7-20f83c8fa010 req-f59d19e8-fe8d-42bf-91a6-e66282c36cee service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:24.311153 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-c05b1ace-8597-4552-81c7-20f83c8fa010 req-f59d19e8-fe8d-42bf-91a6-e66282c36cee service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:24.335114 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-c05b1ace-8597-4552-81c7-20f83c8fa010 req-f59d19e8-fe8d-42bf-91a6-e66282c36cee service nova] Creating event network-changed:4dcfb7ae-10e1-4733-8e99-a050c9e0f38a for instance eb865707-c2a0-4a91-9c92-70e29b1b2a48 on hv-cinder-81268 Dec 15 19:05:24.339868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-c05b1ace-8597-4552-81c7-20f83c8fa010 req-f59d19e8-fe8d-42bf-91a6-e66282c36cee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044087 Dec 15 19:05:24.340487 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 184/383] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:05:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:05:24.412458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-032a8e0a-249b-4196-934e-f85f4dbe5556 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:24.413517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-032a8e0a-249b-4196-934e-f85f4dbe5556 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:24.420038 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-032a8e0a-249b-4196-934e-f85f4dbe5556 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:24.420555 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-032a8e0a-249b-4196-934e-f85f4dbe5556 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:24.422101 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-032a8e0a-249b-4196-934e-f85f4dbe5556 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:24.422561 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-032a8e0a-249b-4196-934e-f85f4dbe5556 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:24.613259 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fabcb779-b95f-48ce-98df-f08130f14f3e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'create', calling method: .version_select at 0x7f80b5c6a550>, body: {"keypair": {"name": "tempest-keypair-776574122"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:24.636426 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-fabcb779-b95f-48ce-98df-f08130f14f3e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:05:24.640016 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-032a8e0a-249b-4196-934e-f85f4dbe5556 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 28663 microversion: 2.20 time: 0.231522 Dec 15 19:05:24.640808 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 185/384] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:24 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 28663 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:05:24.642141 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-fabcb779-b95f-48ce-98df-f08130f14f3e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for user c23109dba24548acb418028b9578f1f8 and project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:05:24.645836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a8f8ecfc-ffc8-46cf-963b-ffa50d985c19 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:24.646546 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a8f8ecfc-ffc8-46cf-963b-ffa50d985c19 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:24.675908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a8f8ecfc-ffc8-46cf-963b-ffa50d985c19 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:24.675908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a8f8ecfc-ffc8-46cf-963b-ffa50d985c19 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:24.675908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a8f8ecfc-ffc8-46cf-963b-ffa50d985c19 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:24.675908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a8f8ecfc-ffc8-46cf-963b-ffa50d985c19 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:25.104901 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a8f8ecfc-ffc8-46cf-963b-ffa50d985c19 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:25.112971 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a8f8ecfc-ffc8-46cf-963b-ffa50d985c19 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.471056 Dec 15 19:05:25.114708 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 186/385] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:24 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:25.123818 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-773740e5-3387-470d-8f5d-4a5a95daf9dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:25.124687 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-773740e5-3387-470d-8f5d-4a5a95daf9dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:25.136519 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-773740e5-3387-470d-8f5d-4a5a95daf9dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:25.137547 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-773740e5-3387-470d-8f5d-4a5a95daf9dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:25.138803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-773740e5-3387-470d-8f5d-4a5a95daf9dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:25.139395 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-773740e5-3387-470d-8f5d-4a5a95daf9dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:25.280569 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-fabcb779-b95f-48ce-98df-f08130f14f3e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:05:25.296192 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-fabcb779-b95f-48ce-98df-f08130f14f3e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for user c23109dba24548acb418028b9578f1f8 and project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:05:25.325849 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fabcb779-b95f-48ce-98df-f08130f14f3e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.109369 Dec 15 19:05:25.335240 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 200/386] 10.222.0.49 () {60 vars in 1157 bytes} [Wed Dec 15 19:05:24 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:25.338356 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-773740e5-3387-470d-8f5d-4a5a95daf9dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:25.341606 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-19c72e24-f80c-44eb-b575-ecd2c1cbdc02 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:25.342773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-19c72e24-f80c-44eb-b575-ecd2c1cbdc02 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:25.349711 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-773740e5-3387-470d-8f5d-4a5a95daf9dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.233458 Dec 15 19:05:25.350980 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 187/387] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:25 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:25.366932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-19c72e24-f80c-44eb-b575-ecd2c1cbdc02 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:25.367088 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-bb77122d-f98c-4cc6-831c-31321409f47f req-36a0847e-1517-476a-99b4-52df797c0a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e09c87-53f0-4d48-9eba-d5adae8227e3", "name": "network-vif-plugged", "status": "completed", "tag": "828144f6-72f4-4245-b754-2f3f975b9c13"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:25.367177 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-19c72e24-f80c-44eb-b575-ecd2c1cbdc02 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:25.367177 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-19c72e24-f80c-44eb-b575-ecd2c1cbdc02 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:25.367177 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-19c72e24-f80c-44eb-b575-ecd2c1cbdc02 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:25.367385 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:05:25.367385 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:05:25.399495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-bb77122d-f98c-4cc6-831c-31321409f47f req-36a0847e-1517-476a-99b4-52df797c0a9e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:25.399966 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-bb77122d-f98c-4cc6-831c-31321409f47f req-36a0847e-1517-476a-99b4-52df797c0a9e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:25.418490 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-bb77122d-f98c-4cc6-831c-31321409f47f req-36a0847e-1517-476a-99b4-52df797c0a9e service nova] Creating event network-vif-plugged:828144f6-72f4-4245-b754-2f3f975b9c13 for instance 26e09c87-53f0-4d48-9eba-d5adae8227e3 on hv-cinder-81268 Dec 15 19:05:25.435208 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-bb77122d-f98c-4cc6-831c-31321409f47f req-36a0847e-1517-476a-99b4-52df797c0a9e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076689 Dec 15 19:05:25.435208 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 188/388] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:05:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:05:25.656186 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6438f7db-b3f9-44d1-8fce-d90c2f6d8b22 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:25.657230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6438f7db-b3f9-44d1-8fce-d90c2f6d8b22 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:25.668236 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6438f7db-b3f9-44d1-8fce-d90c2f6d8b22 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:25.668904 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6438f7db-b3f9-44d1-8fce-d90c2f6d8b22 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:25.672713 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6438f7db-b3f9-44d1-8fce-d90c2f6d8b22 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:25.673361 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6438f7db-b3f9-44d1-8fce-d90c2f6d8b22 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:25.793520 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6438f7db-b3f9-44d1-8fce-d90c2f6d8b22 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 29607 microversion: 2.20 time: 0.142210 Dec 15 19:05:25.794494 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 189/389] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:25 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 29607 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:25.913963 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-19c72e24-f80c-44eb-b575-ecd2c1cbdc02 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:25.921991 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-19c72e24-f80c-44eb-b575-ecd2c1cbdc02 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1522 microversion: 2.1 time: 0.584957 Dec 15 19:05:25.929367 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 201/390] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:25 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:26.134056 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9b4d9e87-c2cb-4955-b8f2-719f7ef0e1e7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:26.135011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9b4d9e87-c2cb-4955-b8f2-719f7ef0e1e7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:26.143321 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9b4d9e87-c2cb-4955-b8f2-719f7ef0e1e7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:26.144476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9b4d9e87-c2cb-4955-b8f2-719f7ef0e1e7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:26.145573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9b4d9e87-c2cb-4955-b8f2-719f7ef0e1e7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:26.146248 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9b4d9e87-c2cb-4955-b8f2-719f7ef0e1e7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:26.324617 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9b4d9e87-c2cb-4955-b8f2-719f7ef0e1e7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:26.338434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9b4d9e87-c2cb-4955-b8f2-719f7ef0e1e7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.210726 Dec 15 19:05:26.349072 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 190/391] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:26 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:26.367542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bd7b9af5-a4b7-485e-a895-6e0134e86c61 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:26.369603 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bd7b9af5-a4b7-485e-a895-6e0134e86c61 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:26.376610 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bd7b9af5-a4b7-485e-a895-6e0134e86c61 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:26.377509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bd7b9af5-a4b7-485e-a895-6e0134e86c61 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:26.382057 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bd7b9af5-a4b7-485e-a895-6e0134e86c61 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:26.382057 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bd7b9af5-a4b7-485e-a895-6e0134e86c61 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:26.554374 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bd7b9af5-a4b7-485e-a895-6e0134e86c61 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:26.569600 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bd7b9af5-a4b7-485e-a895-6e0134e86c61 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.205454 Dec 15 19:05:26.570124 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 202/392] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:26 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:26.815539 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9fc36edc-ea85-4912-b187-167bb5103f51 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:26.815539 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9fc36edc-ea85-4912-b187-167bb5103f51 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:26.830555 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fc36edc-ea85-4912-b187-167bb5103f51 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:26.834122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fc36edc-ea85-4912-b187-167bb5103f51 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:26.837112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fc36edc-ea85-4912-b187-167bb5103f51 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:26.840573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fc36edc-ea85-4912-b187-167bb5103f51 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:26.946497 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8aa7996a-d3da-4059-89d9-624231bf43fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:26.947286 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8aa7996a-d3da-4059-89d9-624231bf43fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:26.958627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8aa7996a-d3da-4059-89d9-624231bf43fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:26.958627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8aa7996a-d3da-4059-89d9-624231bf43fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:26.958627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8aa7996a-d3da-4059-89d9-624231bf43fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:26.958627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8aa7996a-d3da-4059-89d9-624231bf43fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:26.986998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9fc36edc-ea85-4912-b187-167bb5103f51 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 30848 microversion: 2.20 time: 0.181758 Dec 15 19:05:26.989594 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 191/393] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:26 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 30848 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:27.212812 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8aa7996a-d3da-4059-89d9-624231bf43fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:27.220845 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8aa7996a-d3da-4059-89d9-624231bf43fc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1502 microversion: 2.1 time: 0.278376 Dec 15 19:05:27.221437 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 203/394] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:26 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:27.238028 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-dcd6f08a-c641-45db-8caf-66decf258f0b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:27.238731 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-dcd6f08a-c641-45db-8caf-66decf258f0b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:27.246821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dcd6f08a-c641-45db-8caf-66decf258f0b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:27.253107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dcd6f08a-c641-45db-8caf-66decf258f0b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:27.253107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dcd6f08a-c641-45db-8caf-66decf258f0b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:27.253107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dcd6f08a-c641-45db-8caf-66decf258f0b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:27.425011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-12da1f34-7b91-4905-93aa-ac1067844b12 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:27.425011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-12da1f34-7b91-4905-93aa-ac1067844b12 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:27.425011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-12da1f34-7b91-4905-93aa-ac1067844b12 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:27.425011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-12da1f34-7b91-4905-93aa-ac1067844b12 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:27.426200 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-12da1f34-7b91-4905-93aa-ac1067844b12 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:27.426200 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-12da1f34-7b91-4905-93aa-ac1067844b12 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:27.426492 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-dcd6f08a-c641-45db-8caf-66decf258f0b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:27.437760 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-dcd6f08a-c641-45db-8caf-66decf258f0b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1515 microversion: 2.1 time: 0.192579 Dec 15 19:05:27.438449 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 192/395] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:27 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:27.573001 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-12da1f34-7b91-4905-93aa-ac1067844b12 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:27.584520 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-12da1f34-7b91-4905-93aa-ac1067844b12 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1319 microversion: 2.1 time: 0.232641 Dec 15 19:05:27.597461 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 204/396] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:27 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:27.597556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-37051c1c-bcf0-46b5-8986-8225cf4df542 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:27.597556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-37051c1c-bcf0-46b5-8986-8225cf4df542 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:27.624499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-37051c1c-bcf0-46b5-8986-8225cf4df542 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:27.624905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-37051c1c-bcf0-46b5-8986-8225cf4df542 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:27.627626 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-37051c1c-bcf0-46b5-8986-8225cf4df542 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:27.633625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-37051c1c-bcf0-46b5-8986-8225cf4df542 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:27.889119 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-37051c1c-bcf0-46b5-8986-8225cf4df542 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:27.898917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-37051c1c-bcf0-46b5-8986-8225cf4df542 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.315183 Dec 15 19:05:27.908962 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 193/397] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:27 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:27.998425 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7b95bbd5-83fe-4d36-a97f-a73c6309ffa4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:27.999643 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7b95bbd5-83fe-4d36-a97f-a73c6309ffa4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:28.011710 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7b95bbd5-83fe-4d36-a97f-a73c6309ffa4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:28.011710 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7b95bbd5-83fe-4d36-a97f-a73c6309ffa4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:28.011710 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7b95bbd5-83fe-4d36-a97f-a73c6309ffa4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:28.011710 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7b95bbd5-83fe-4d36-a97f-a73c6309ffa4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:28.109630 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7b95bbd5-83fe-4d36-a97f-a73c6309ffa4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 31875 microversion: 2.20 time: 0.109121 Dec 15 19:05:28.109630 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 205/398] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:27 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 31875 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:28.602366 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5f64d09f-60d0-4bb5-9762-fe6f87473e54 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:28.603068 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5f64d09f-60d0-4bb5-9762-fe6f87473e54 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:28.610429 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f64d09f-60d0-4bb5-9762-fe6f87473e54 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:28.610948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f64d09f-60d0-4bb5-9762-fe6f87473e54 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:28.611992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f64d09f-60d0-4bb5-9762-fe6f87473e54 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:28.613597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f64d09f-60d0-4bb5-9762-fe6f87473e54 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:28.824647 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5f64d09f-60d0-4bb5-9762-fe6f87473e54 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:28.834197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5f64d09f-60d0-4bb5-9762-fe6f87473e54 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1508 microversion: 2.1 time: 0.234476 Dec 15 19:05:28.835379 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 194/399] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:28 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:28.917842 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b9604c94-08c9-444c-ad05-9060d02e3f0a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:28.919099 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b9604c94-08c9-444c-ad05-9060d02e3f0a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:28.955716 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b9604c94-08c9-444c-ad05-9060d02e3f0a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:28.957356 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b9604c94-08c9-444c-ad05-9060d02e3f0a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:28.958295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b9604c94-08c9-444c-ad05-9060d02e3f0a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:28.960061 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b9604c94-08c9-444c-ad05-9060d02e3f0a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:29.117718 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-29e4f2ef-8326-4972-8782-f6b357870cce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:29.118956 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-29e4f2ef-8326-4972-8782-f6b357870cce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:29.129799 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-29e4f2ef-8326-4972-8782-f6b357870cce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:29.129799 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-29e4f2ef-8326-4972-8782-f6b357870cce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:29.129799 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-29e4f2ef-8326-4972-8782-f6b357870cce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:29.129799 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-29e4f2ef-8326-4972-8782-f6b357870cce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:29.262542 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-29e4f2ef-8326-4972-8782-f6b357870cce tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 32979 microversion: 2.20 time: 0.145213 Dec 15 19:05:29.269061 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 195/400] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:29 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 32979 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:29.341659 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b9604c94-08c9-444c-ad05-9060d02e3f0a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:29.349969 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b9604c94-08c9-444c-ad05-9060d02e3f0a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.437629 Dec 15 19:05:29.351081 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 206/401] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:28 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:29.666128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1365496481", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a16e66f-ed7c-442f-a539-7233fbc514d4"}], "security_groups": [{"name": "tempest-securitygroup--1177622843"}], "key_name": "tempest-keypair-776574122", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:29.773760 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] validate_networks() for [('7a16e66f-ed7c-442f-a539-7233fbc514d4', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:05:29.962890 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c5a04afc-222f-4a16-aa96-941ead79cb69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:29.964034 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c5a04afc-222f-4a16-aa96-941ead79cb69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:29.988038 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5a04afc-222f-4a16-aa96-941ead79cb69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:29.988038 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5a04afc-222f-4a16-aa96-941ead79cb69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:29.988038 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5a04afc-222f-4a16-aa96-941ead79cb69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:29.988038 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c5a04afc-222f-4a16-aa96-941ead79cb69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:30.035749 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-c5a04afc-222f-4a16-aa96-941ead79cb69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lazy-loading 'flavor' on Instance uuid 93f130e2-e041-400a-934f-9c837ba505ef {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:05:30.323569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:05:30.324372 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:05:30.324856 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:05:30.325454 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:05:30.325863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:05:30.335135 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:30.335591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:30.336445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:30.336877 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:30.355045 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:05:30.358986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for user c23109dba24548acb418028b9578f1f8 and project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:05:30.370202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:05:30.377620 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:05:30.402307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c5a04afc-222f-4a16-aa96-941ead79cb69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/action" status: 200 len: 32 microversion: 2.1 time: 0.444330 Dec 15 19:05:30.402980 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 207/402] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:05:29 2021] POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:05:30.409008 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9fc74ee6-8b30-4c18-aac8-ed965721a626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:30.410195 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9fc74ee6-8b30-4c18-aac8-ed965721a626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:30.417579 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9fc74ee6-8b30-4c18-aac8-ed965721a626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:30.418307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9fc74ee6-8b30-4c18-aac8-ed965721a626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:30.419107 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9fc74ee6-8b30-4c18-aac8-ed965721a626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:30.419551 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9fc74ee6-8b30-4c18-aac8-ed965721a626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:30.514425 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-503ceab9-4bbd-4de4-8b51-81dbb3d6af4c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.853474 Dec 15 19:05:30.515975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 196/403] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:05:29 2021] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:05:30.521799 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9fc74ee6-8b30-4c18-aac8-ed965721a626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 33456 microversion: 2.20 time: 0.117163 Dec 15 19:05:30.522762 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 208/404] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:30 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 33456 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:30.527814 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-23ce440d-f593-4192-bd8a-325ad597f2a5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:30.537354 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-23ce440d-f593-4192-bd8a-325ad597f2a5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:30.537480 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c51a7c21-3609-4440-8120-1ba5ad477b48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:30.537480 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c51a7c21-3609-4440-8120-1ba5ad477b48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:30.566266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23ce440d-f593-4192-bd8a-325ad597f2a5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:30.566980 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23ce440d-f593-4192-bd8a-325ad597f2a5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:30.569625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c51a7c21-3609-4440-8120-1ba5ad477b48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:30.569971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23ce440d-f593-4192-bd8a-325ad597f2a5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:30.570508 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23ce440d-f593-4192-bd8a-325ad597f2a5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:30.575931 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c51a7c21-3609-4440-8120-1ba5ad477b48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:30.577666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c51a7c21-3609-4440-8120-1ba5ad477b48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:30.578382 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c51a7c21-3609-4440-8120-1ba5ad477b48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:30.827894 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-23ce440d-f593-4192-bd8a-325ad597f2a5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:30.833499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c51a7c21-3609-4440-8120-1ba5ad477b48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:30.843435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c51a7c21-3609-4440-8120-1ba5ad477b48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.326083 Dec 15 19:05:30.844341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-23ce440d-f593-4192-bd8a-325ad597f2a5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.320179 Dec 15 19:05:30.844554 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 197/405] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:30 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:30.850335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 209/406] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:30 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:30.859802 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4c106e29-4d87-46d9-8ac5-1acb5080d2f5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:30.860646 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4c106e29-4d87-46d9-8ac5-1acb5080d2f5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:30.942920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4c106e29-4d87-46d9-8ac5-1acb5080d2f5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:30.950899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4c106e29-4d87-46d9-8ac5-1acb5080d2f5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1237 microversion: 2.1 time: 0.104971 Dec 15 19:05:30.951483 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 198/407] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:30 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:31.534650 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e22b7d9f-7323-4264-8ff8-b457cea732be tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:31.536177 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e22b7d9f-7323-4264-8ff8-b457cea732be tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:31.543472 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e22b7d9f-7323-4264-8ff8-b457cea732be tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:31.544172 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e22b7d9f-7323-4264-8ff8-b457cea732be tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:31.544959 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e22b7d9f-7323-4264-8ff8-b457cea732be tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:31.545426 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e22b7d9f-7323-4264-8ff8-b457cea732be tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:31.643929 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e22b7d9f-7323-4264-8ff8-b457cea732be tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 33926 microversion: 2.20 time: 0.113545 Dec 15 19:05:31.644823 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 210/408] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:31 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 33926 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:31.862678 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6b72f85d-d887-497b-9038-cd325664a778 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:31.863334 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-de98fec3-caeb-42e2-a81f-29ef7561ebfd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:31.863780 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6b72f85d-d887-497b-9038-cd325664a778 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:31.863970 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-de98fec3-caeb-42e2-a81f-29ef7561ebfd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:31.871336 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6b72f85d-d887-497b-9038-cd325664a778 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:31.871806 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6b72f85d-d887-497b-9038-cd325664a778 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:31.872975 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6b72f85d-d887-497b-9038-cd325664a778 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:31.873482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6b72f85d-d887-497b-9038-cd325664a778 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:31.890780 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de98fec3-caeb-42e2-a81f-29ef7561ebfd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:31.891319 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de98fec3-caeb-42e2-a81f-29ef7561ebfd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:31.892177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de98fec3-caeb-42e2-a81f-29ef7561ebfd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:31.893321 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de98fec3-caeb-42e2-a81f-29ef7561ebfd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:32.048323 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6b72f85d-d887-497b-9038-cd325664a778 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:32.056148 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-de98fec3-caeb-42e2-a81f-29ef7561ebfd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:32.056443 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6b72f85d-d887-497b-9038-cd325664a778 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.197839 Dec 15 19:05:32.056997 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 211/409] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:31 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:32.069608 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-de98fec3-caeb-42e2-a81f-29ef7561ebfd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.208059 Dec 15 19:05:32.069747 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f58d119b-3569-4565-81a9-cb67e5bd7e26 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:32.069826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 199/410] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:31 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:32.069898 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f58d119b-3569-4565-81a9-cb67e5bd7e26 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:32.071928 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f58d119b-3569-4565-81a9-cb67e5bd7e26 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:32.072376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f58d119b-3569-4565-81a9-cb67e5bd7e26 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:32.073186 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f58d119b-3569-4565-81a9-cb67e5bd7e26 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:32.073625 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f58d119b-3569-4565-81a9-cb67e5bd7e26 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:32.147519 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f58d119b-3569-4565-81a9-cb67e5bd7e26 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:32.155529 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f58d119b-3569-4565-81a9-cb67e5bd7e26 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1241 microversion: 2.1 time: 0.097522 Dec 15 19:05:32.156094 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 212/411] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:32 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:32.655992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-79c6c8f6-bfaa-4fec-bac7-658ae9cb4eb0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:32.657217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-79c6c8f6-bfaa-4fec-bac7-658ae9cb4eb0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:32.663177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79c6c8f6-bfaa-4fec-bac7-658ae9cb4eb0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:32.663836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79c6c8f6-bfaa-4fec-bac7-658ae9cb4eb0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:32.664740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79c6c8f6-bfaa-4fec-bac7-658ae9cb4eb0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:32.665202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79c6c8f6-bfaa-4fec-bac7-658ae9cb4eb0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:33.074418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3fe009b4-ace4-4dfd-ad3d-a3b6684f2f68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:33.075029 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3fe009b4-ace4-4dfd-ad3d-a3b6684f2f68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:33.081851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3fe009b4-ace4-4dfd-ad3d-a3b6684f2f68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:33.082309 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3fe009b4-ace4-4dfd-ad3d-a3b6684f2f68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:33.083087 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3fe009b4-ace4-4dfd-ad3d-a3b6684f2f68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:33.083526 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3fe009b4-ace4-4dfd-ad3d-a3b6684f2f68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:33.216388 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3fe009b4-ace4-4dfd-ad3d-a3b6684f2f68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:33.221267 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3fe009b4-ace4-4dfd-ad3d-a3b6684f2f68 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.150530 Dec 15 19:05:33.222001 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 213/412] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:33 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:33.237500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ebd3e2fc-b909-4e9b-93d9-b6cfb2fbaafa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:33.237500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ebd3e2fc-b909-4e9b-93d9-b6cfb2fbaafa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:33.255474 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebd3e2fc-b909-4e9b-93d9-b6cfb2fbaafa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:33.261819 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebd3e2fc-b909-4e9b-93d9-b6cfb2fbaafa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:33.261819 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebd3e2fc-b909-4e9b-93d9-b6cfb2fbaafa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:33.261819 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebd3e2fc-b909-4e9b-93d9-b6cfb2fbaafa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:33.411552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ebd3e2fc-b909-4e9b-93d9-b6cfb2fbaafa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:33.418675 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ebd3e2fc-b909-4e9b-93d9-b6cfb2fbaafa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.186789 Dec 15 19:05:33.419232 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 214/413] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:33 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:33.423346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-822d10bb-403f-4312-9f5d-ffa91e3d16b6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:33.423936 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-822d10bb-403f-4312-9f5d-ffa91e3d16b6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:33.429325 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-822d10bb-403f-4312-9f5d-ffa91e3d16b6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:33.432711 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-822d10bb-403f-4312-9f5d-ffa91e3d16b6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:33.432711 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-822d10bb-403f-4312-9f5d-ffa91e3d16b6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:33.432711 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-822d10bb-403f-4312-9f5d-ffa91e3d16b6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:33.487760 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-822d10bb-403f-4312-9f5d-ffa91e3d16b6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:33.494971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-822d10bb-403f-4312-9f5d-ffa91e3d16b6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1233 microversion: 2.1 time: 0.074792 Dec 15 19:05:33.495534 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 215/414] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:33 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1233 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:34.239014 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-22539a4f-05f1-49f8-a7d6-629a0456512e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:34.239697 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-22539a4f-05f1-49f8-a7d6-629a0456512e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:34.246268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-22539a4f-05f1-49f8-a7d6-629a0456512e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:34.254224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-22539a4f-05f1-49f8-a7d6-629a0456512e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:34.254224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-22539a4f-05f1-49f8-a7d6-629a0456512e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:34.254224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-22539a4f-05f1-49f8-a7d6-629a0456512e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:34.386975 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-22539a4f-05f1-49f8-a7d6-629a0456512e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:34.394962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-22539a4f-05f1-49f8-a7d6-629a0456512e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.159716 Dec 15 19:05:34.401348 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 216/415] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:34 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:34.435994 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-42e6ce43-e03b-4fce-b2a1-56191124e503 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:34.436771 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-42e6ce43-e03b-4fce-b2a1-56191124e503 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:34.442877 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-42e6ce43-e03b-4fce-b2a1-56191124e503 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:34.443407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-42e6ce43-e03b-4fce-b2a1-56191124e503 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:34.444691 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-42e6ce43-e03b-4fce-b2a1-56191124e503 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:34.445376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-42e6ce43-e03b-4fce-b2a1-56191124e503 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:34.582068 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-42e6ce43-e03b-4fce-b2a1-56191124e503 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:34.590480 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-42e6ce43-e03b-4fce-b2a1-56191124e503 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.158340 Dec 15 19:05:34.605901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 217/416] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:34 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:34.605901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-057a0d93-2548-4a4e-970e-aacbd653d814 req-9e427934-bfd8-451b-b99b-366e7bee0885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb865707-c2a0-4a91-9c92-70e29b1b2a48", "name": "network-vif-plugged", "status": "completed", "tag": "4dcfb7ae-10e1-4733-8e99-a050c9e0f38a"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:34.605901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:05:34.605901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:05:34.612879 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-057a0d93-2548-4a4e-970e-aacbd653d814 req-9e427934-bfd8-451b-b99b-366e7bee0885 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:34.613455 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-057a0d93-2548-4a4e-970e-aacbd653d814 req-9e427934-bfd8-451b-b99b-366e7bee0885 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:34.625953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-057a0d93-2548-4a4e-970e-aacbd653d814 req-9e427934-bfd8-451b-b99b-366e7bee0885 service nova] Creating event network-vif-plugged:4dcfb7ae-10e1-4733-8e99-a050c9e0f38a for instance eb865707-c2a0-4a91-9c92-70e29b1b2a48 on hv-cinder-81268 Dec 15 19:05:34.631652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-057a0d93-2548-4a4e-970e-aacbd653d814 req-9e427934-bfd8-451b-b99b-366e7bee0885 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035181 Dec 15 19:05:34.632386 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 218/417] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:05:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:05:34.638002 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9d1e763a-6b87-4c3a-b225-19c55a95f83d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:34.638774 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9d1e763a-6b87-4c3a-b225-19c55a95f83d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:34.645943 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9d1e763a-6b87-4c3a-b225-19c55a95f83d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:34.646465 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9d1e763a-6b87-4c3a-b225-19c55a95f83d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:34.647471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9d1e763a-6b87-4c3a-b225-19c55a95f83d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:34.647935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9d1e763a-6b87-4c3a-b225-19c55a95f83d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:34.711647 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9d1e763a-6b87-4c3a-b225-19c55a95f83d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:34.719490 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9d1e763a-6b87-4c3a-b225-19c55a95f83d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1233 microversion: 2.1 time: 0.085882 Dec 15 19:05:34.720057 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 219/418] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:34 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:35.380373 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-79c6c8f6-bfaa-4fec-bac7-658ae9cb4eb0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 36969 microversion: 2.20 time: 2.727963 Dec 15 19:05:35.382557 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 200/419] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:32 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 36969 bytes in 2731 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:35.411634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c0470c70-cbe3-46fd-8106-f547e324133e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:35.412316 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c0470c70-cbe3-46fd-8106-f547e324133e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:35.418936 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0470c70-cbe3-46fd-8106-f547e324133e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:35.419498 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0470c70-cbe3-46fd-8106-f547e324133e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:35.420351 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0470c70-cbe3-46fd-8106-f547e324133e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:35.420875 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0470c70-cbe3-46fd-8106-f547e324133e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:35.586303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c0470c70-cbe3-46fd-8106-f547e324133e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:35.595101 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c0470c70-cbe3-46fd-8106-f547e324133e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.187019 Dec 15 19:05:35.601179 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 220/420] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:35 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:35.612362 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-70bd82b1-b8ba-4380-b0c2-e7565db92dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:35.613063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-70bd82b1-b8ba-4380-b0c2-e7565db92dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:35.620028 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-70bd82b1-b8ba-4380-b0c2-e7565db92dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:35.620479 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-70bd82b1-b8ba-4380-b0c2-e7565db92dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:35.621319 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-70bd82b1-b8ba-4380-b0c2-e7565db92dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:35.621837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-70bd82b1-b8ba-4380-b0c2-e7565db92dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:35.736454 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-44d55e46-9332-4b24-b429-f51757aba0e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:35.737057 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-44d55e46-9332-4b24-b429-f51757aba0e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:35.743027 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-44d55e46-9332-4b24-b429-f51757aba0e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:35.743470 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-44d55e46-9332-4b24-b429-f51757aba0e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:35.746899 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-44d55e46-9332-4b24-b429-f51757aba0e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:35.746899 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-44d55e46-9332-4b24-b429-f51757aba0e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:35.805741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-70bd82b1-b8ba-4380-b0c2-e7565db92dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:35.807375 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-44d55e46-9332-4b24-b429-f51757aba0e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:35.813747 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-70bd82b1-b8ba-4380-b0c2-e7565db92dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.205543 Dec 15 19:05:35.814308 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 201/421] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:35 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:35.818804 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-44d55e46-9332-4b24-b429-f51757aba0e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1289 microversion: 2.1 time: 0.084348 Dec 15 19:05:35.819392 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 221/422] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:35 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:36.393272 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-66b43dc2-82cf-40a8-a50b-f14ba48ca448 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:36.394173 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-66b43dc2-82cf-40a8-a50b-f14ba48ca448 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:36.400666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-66b43dc2-82cf-40a8-a50b-f14ba48ca448 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:36.401269 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-66b43dc2-82cf-40a8-a50b-f14ba48ca448 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:36.402062 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-66b43dc2-82cf-40a8-a50b-f14ba48ca448 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:36.402499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-66b43dc2-82cf-40a8-a50b-f14ba48ca448 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:36.505143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-66b43dc2-82cf-40a8-a50b-f14ba48ca448 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 37662 microversion: 2.20 time: 0.115522 Dec 15 19:05:36.506061 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 202/423] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:36 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 37662 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:36.612416 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1c394d8c-5396-48fb-bb63-b6258eec04fa tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:36.613035 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1c394d8c-5396-48fb-bb63-b6258eec04fa tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:36.619952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1c394d8c-5396-48fb-bb63-b6258eec04fa tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:36.623306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1c394d8c-5396-48fb-bb63-b6258eec04fa tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:36.623306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1c394d8c-5396-48fb-bb63-b6258eec04fa tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:36.623306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1c394d8c-5396-48fb-bb63-b6258eec04fa tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:36.831580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ea2794de-30e9-4592-b378-b55a2ded0901 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:36.832430 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ea2794de-30e9-4592-b378-b55a2ded0901 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:36.839830 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea2794de-30e9-4592-b378-b55a2ded0901 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:36.840276 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea2794de-30e9-4592-b378-b55a2ded0901 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:36.841250 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea2794de-30e9-4592-b378-b55a2ded0901 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:36.841740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea2794de-30e9-4592-b378-b55a2ded0901 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:36.861540 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1c394d8c-5396-48fb-bb63-b6258eec04fa tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:36.869117 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1c394d8c-5396-48fb-bb63-b6258eec04fa tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.261171 Dec 15 19:05:36.881857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 222/424] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:36 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:36.887308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-58b443ad-bea3-4935-973f-fc758c6e90ab tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:36.888067 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-58b443ad-bea3-4935-973f-fc758c6e90ab tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:36.894824 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-58b443ad-bea3-4935-973f-fc758c6e90ab tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:36.895527 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-58b443ad-bea3-4935-973f-fc758c6e90ab tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:36.896570 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-58b443ad-bea3-4935-973f-fc758c6e90ab tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:36.897170 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-58b443ad-bea3-4935-973f-fc758c6e90ab tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:37.005864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ea2794de-30e9-4592-b378-b55a2ded0901 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:37.014636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ea2794de-30e9-4592-b378-b55a2ded0901 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1317 microversion: 2.1 time: 0.187573 Dec 15 19:05:37.023549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 203/425] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:36 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:37.196145 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-58b443ad-bea3-4935-973f-fc758c6e90ab tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:37.205340 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-58b443ad-bea3-4935-973f-fc758c6e90ab tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1297 microversion: 2.1 time: 0.321645 Dec 15 19:05:37.206445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 223/426] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:36 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1297 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:37.518232 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-afac1803-4215-4d14-adb1-089277db50e3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:37.519209 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-afac1803-4215-4d14-adb1-089277db50e3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:37.525675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afac1803-4215-4d14-adb1-089277db50e3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:37.526299 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afac1803-4215-4d14-adb1-089277db50e3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:37.527150 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afac1803-4215-4d14-adb1-089277db50e3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:37.527652 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afac1803-4215-4d14-adb1-089277db50e3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:37.642635 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-afac1803-4215-4d14-adb1-089277db50e3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 38121 microversion: 2.20 time: 0.128794 Dec 15 19:05:37.643861 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 204/427] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:37 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 38121 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:37.887445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5685c87e-123a-4b52-94c9-d39b50f36c95 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:37.888622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5685c87e-123a-4b52-94c9-d39b50f36c95 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:37.895311 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5685c87e-123a-4b52-94c9-d39b50f36c95 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:37.896021 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5685c87e-123a-4b52-94c9-d39b50f36c95 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:37.896981 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5685c87e-123a-4b52-94c9-d39b50f36c95 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:37.898568 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5685c87e-123a-4b52-94c9-d39b50f36c95 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:38.033802 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9cd4fb1b-8316-4598-8636-f36d242da03a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:38.034871 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9cd4fb1b-8316-4598-8636-f36d242da03a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:38.042008 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9cd4fb1b-8316-4598-8636-f36d242da03a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:38.042462 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9cd4fb1b-8316-4598-8636-f36d242da03a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:38.043247 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9cd4fb1b-8316-4598-8636-f36d242da03a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:38.043850 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9cd4fb1b-8316-4598-8636-f36d242da03a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:38.120561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5685c87e-123a-4b52-94c9-d39b50f36c95 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:38.140193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5685c87e-123a-4b52-94c9-d39b50f36c95 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.257240 Dec 15 19:05:38.140772 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 224/428] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:37 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:38.225640 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-206271b5-c708-4c3a-8ccd-b37887afc107 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:38.226774 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-206271b5-c708-4c3a-8ccd-b37887afc107 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:38.234416 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-206271b5-c708-4c3a-8ccd-b37887afc107 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:38.234860 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-206271b5-c708-4c3a-8ccd-b37887afc107 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:38.235713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-206271b5-c708-4c3a-8ccd-b37887afc107 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:38.236143 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-206271b5-c708-4c3a-8ccd-b37887afc107 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:38.297118 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9cd4fb1b-8316-4598-8636-f36d242da03a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:38.316398 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9cd4fb1b-8316-4598-8636-f36d242da03a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1508 microversion: 2.1 time: 0.288420 Dec 15 19:05:38.320613 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 205/429] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:38 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:38.515586 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-206271b5-c708-4c3a-8ccd-b37887afc107 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:38.534413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-206271b5-c708-4c3a-8ccd-b37887afc107 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.313519 Dec 15 19:05:38.545137 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 225/430] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:38 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:38.655058 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bee059f0-cd50-4f8f-802e-aaf7bbe1a64f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:38.656087 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bee059f0-cd50-4f8f-802e-aaf7bbe1a64f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:38.663059 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bee059f0-cd50-4f8f-802e-aaf7bbe1a64f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:38.663509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bee059f0-cd50-4f8f-802e-aaf7bbe1a64f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:38.664291 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bee059f0-cd50-4f8f-802e-aaf7bbe1a64f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:38.664729 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bee059f0-cd50-4f8f-802e-aaf7bbe1a64f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:38.839770 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bee059f0-cd50-4f8f-802e-aaf7bbe1a64f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 38159 microversion: 2.20 time: 0.188315 Dec 15 19:05:38.840433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 206/431] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:38 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 38159 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:05:39.158306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3a3be82e-7fd6-4471-9a7e-ac7ccdd923e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:39.158849 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3a3be82e-7fd6-4471-9a7e-ac7ccdd923e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:39.169111 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3a3be82e-7fd6-4471-9a7e-ac7ccdd923e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:39.169600 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3a3be82e-7fd6-4471-9a7e-ac7ccdd923e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:39.174967 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3a3be82e-7fd6-4471-9a7e-ac7ccdd923e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:39.175534 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3a3be82e-7fd6-4471-9a7e-ac7ccdd923e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:39.181783 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-9a4d6d29-d5d6-4ff7-9949-83a75a34d9d9 req-d622f5fa-41cc-494b-a1a2-03c6b9ec6821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92d9554d-bb60-4d4e-9ab8-311caafb659f", "tag": "29640191-71ad-4c57-b1eb-eb8f4de83e2b"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:39.183170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:05:39.183170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:05:39.204886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-9a4d6d29-d5d6-4ff7-9949-83a75a34d9d9 req-d622f5fa-41cc-494b-a1a2-03c6b9ec6821 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:39.217230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-9a4d6d29-d5d6-4ff7-9949-83a75a34d9d9 req-d622f5fa-41cc-494b-a1a2-03c6b9ec6821 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:39.261981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-9a4d6d29-d5d6-4ff7-9949-83a75a34d9d9 req-d622f5fa-41cc-494b-a1a2-03c6b9ec6821 service nova] Creating event network-changed:29640191-71ad-4c57-b1eb-eb8f4de83e2b for instance 92d9554d-bb60-4d4e-9ab8-311caafb659f on hv-cinder-81268 Dec 15 19:05:39.273932 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-9a4d6d29-d5d6-4ff7-9949-83a75a34d9d9 req-d622f5fa-41cc-494b-a1a2-03c6b9ec6821 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096010 Dec 15 19:05:39.274832 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 207/432] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:05:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:05:39.464337 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3a3be82e-7fd6-4471-9a7e-ac7ccdd923e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:39.473757 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3a3be82e-7fd6-4471-9a7e-ac7ccdd923e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.320192 Dec 15 19:05:39.483661 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 226/433] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:39 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:39.552478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-349c3da6-0c96-4cf0-bee0-b11d7f84575f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:39.553487 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-349c3da6-0c96-4cf0-bee0-b11d7f84575f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:39.560700 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-349c3da6-0c96-4cf0-bee0-b11d7f84575f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:39.561364 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-349c3da6-0c96-4cf0-bee0-b11d7f84575f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:39.562159 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-349c3da6-0c96-4cf0-bee0-b11d7f84575f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:39.562860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-349c3da6-0c96-4cf0-bee0-b11d7f84575f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:39.744690 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-349c3da6-0c96-4cf0-bee0-b11d7f84575f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:39.753197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-349c3da6-0c96-4cf0-bee0-b11d7f84575f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.205201 Dec 15 19:05:39.753784 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 208/434] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:39 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:39.851857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-553cd411-45ee-487b-b13f-4a841613ef8b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:39.852877 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-553cd411-45ee-487b-b13f-4a841613ef8b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:39.858864 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-553cd411-45ee-487b-b13f-4a841613ef8b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:39.859383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-553cd411-45ee-487b-b13f-4a841613ef8b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:39.860183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-553cd411-45ee-487b-b13f-4a841613ef8b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:39.861155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-553cd411-45ee-487b-b13f-4a841613ef8b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:39.977393 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-553cd411-45ee-487b-b13f-4a841613ef8b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 200 len: 38300 microversion: 2.20 time: 0.129194 Dec 15 19:05:39.978047 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 227/435] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:39 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 38300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:05:39.989549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ea5f1dee-ea9e-4473-8d18-b0290ef9ba91 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:39.990340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ea5f1dee-ea9e-4473-8d18-b0290ef9ba91 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:39.999278 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea5f1dee-ea9e-4473-8d18-b0290ef9ba91 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:39.999887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea5f1dee-ea9e-4473-8d18-b0290ef9ba91 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:40.000915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea5f1dee-ea9e-4473-8d18-b0290ef9ba91 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:40.002085 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea5f1dee-ea9e-4473-8d18-b0290ef9ba91 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:40.027558 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ea5f1dee-ea9e-4473-8d18-b0290ef9ba91 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/ips" status: 200 len: 150 microversion: 2.20 time: 0.042837 Dec 15 19:05:40.028249 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 209/436] 10.222.0.49 () {60 vars in 1288 bytes} [Wed Dec 15 19:05:39 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:05:40.159170 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-07efc9e2-1daf-4012-aed9-b53ddcca3ad6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e7a0b86-8850-449f-9c28-0fccabded88c"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:40.164080 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-07efc9e2-1daf-4012-aed9-b53ddcca3ad6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:40.175887 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-07efc9e2-1daf-4012-aed9-b53ddcca3ad6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:40.176679 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-07efc9e2-1daf-4012-aed9-b53ddcca3ad6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:40.178215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-07efc9e2-1daf-4012-aed9-b53ddcca3ad6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:40.178869 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-07efc9e2-1daf-4012-aed9-b53ddcca3ad6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:40.492385 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2f9543e8-59d6-40b7-be58-e84092dd8137 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:40.492988 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2f9543e8-59d6-40b7-be58-e84092dd8137 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:40.498969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2f9543e8-59d6-40b7-be58-e84092dd8137 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:40.499418 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2f9543e8-59d6-40b7-be58-e84092dd8137 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:40.500192 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2f9543e8-59d6-40b7-be58-e84092dd8137 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:40.500624 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2f9543e8-59d6-40b7-be58-e84092dd8137 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:40.632187 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2f9543e8-59d6-40b7-be58-e84092dd8137 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:40.639565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2f9543e8-59d6-40b7-be58-e84092dd8137 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.151689 Dec 15 19:05:40.640138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 210/437] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:40 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:40.772255 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-69591a0b-8ad7-4bad-a268-3910bd392592 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:40.773759 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-69591a0b-8ad7-4bad-a268-3910bd392592 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:40.787542 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-69591a0b-8ad7-4bad-a268-3910bd392592 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:40.788046 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-69591a0b-8ad7-4bad-a268-3910bd392592 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:40.788836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-69591a0b-8ad7-4bad-a268-3910bd392592 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:40.789458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-69591a0b-8ad7-4bad-a268-3910bd392592 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:40.952770 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-69591a0b-8ad7-4bad-a268-3910bd392592 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:40.960837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-69591a0b-8ad7-4bad-a268-3910bd392592 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.193123 Dec 15 19:05:40.961444 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 211/438] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:40 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:41.010569 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-07efc9e2-1daf-4012-aed9-b53ddcca3ad6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "POST /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857039 Dec 15 19:05:41.011209 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 228/439] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:05:40 2021] POST /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:05:41.658485 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-38493734-8900-4d94-a749-4189b2e6f12c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:41.659147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-38493734-8900-4d94-a749-4189b2e6f12c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:41.666221 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-38493734-8900-4d94-a749-4189b2e6f12c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:41.666754 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-38493734-8900-4d94-a749-4189b2e6f12c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:41.667588 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-38493734-8900-4d94-a749-4189b2e6f12c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:41.668022 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-38493734-8900-4d94-a749-4189b2e6f12c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:41.800269 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-38493734-8900-4d94-a749-4189b2e6f12c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:41.807686 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-38493734-8900-4d94-a749-4189b2e6f12c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.153696 Dec 15 19:05:41.808258 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 212/440] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:41 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:41.978220 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-234b4a98-236e-46cb-abe3-0d0ac959b5b3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:41.978921 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-234b4a98-236e-46cb-abe3-0d0ac959b5b3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:41.986215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-234b4a98-236e-46cb-abe3-0d0ac959b5b3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:41.986671 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-234b4a98-236e-46cb-abe3-0d0ac959b5b3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:41.987469 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-234b4a98-236e-46cb-abe3-0d0ac959b5b3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:41.987907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-234b4a98-236e-46cb-abe3-0d0ac959b5b3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:42.169486 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-234b4a98-236e-46cb-abe3-0d0ac959b5b3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:42.176713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-234b4a98-236e-46cb-abe3-0d0ac959b5b3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.202952 Dec 15 19:05:42.177316 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 229/441] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:41 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:42.828583 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3af5902c-aa07-4a07-b52a-b3e38791b374 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:42.830030 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3af5902c-aa07-4a07-b52a-b3e38791b374 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:42.845226 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3af5902c-aa07-4a07-b52a-b3e38791b374 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:42.845686 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3af5902c-aa07-4a07-b52a-b3e38791b374 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:42.846486 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3af5902c-aa07-4a07-b52a-b3e38791b374 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:42.846922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3af5902c-aa07-4a07-b52a-b3e38791b374 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:43.042345 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3af5902c-aa07-4a07-b52a-b3e38791b374 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:43.051051 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3af5902c-aa07-4a07-b52a-b3e38791b374 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.228329 Dec 15 19:05:43.051565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 213/442] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:42 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:43.193694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6ccdc377-7a19-4799-9512-7949a19315ec tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:43.194306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6ccdc377-7a19-4799-9512-7949a19315ec tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:43.200547 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ccdc377-7a19-4799-9512-7949a19315ec tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:43.201005 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ccdc377-7a19-4799-9512-7949a19315ec tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:43.201846 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ccdc377-7a19-4799-9512-7949a19315ec tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:43.202286 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ccdc377-7a19-4799-9512-7949a19315ec tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:43.471170 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6ccdc377-7a19-4799-9512-7949a19315ec tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:43.482241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6ccdc377-7a19-4799-9512-7949a19315ec tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.291981 Dec 15 19:05:43.483071 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 230/443] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:43 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:44.067790 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8fdd79f7-03b2-47eb-98c8-7c222afa1aeb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:44.069031 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8fdd79f7-03b2-47eb-98c8-7c222afa1aeb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:44.085210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fdd79f7-03b2-47eb-98c8-7c222afa1aeb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:44.085989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fdd79f7-03b2-47eb-98c8-7c222afa1aeb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:44.086729 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fdd79f7-03b2-47eb-98c8-7c222afa1aeb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:44.087158 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fdd79f7-03b2-47eb-98c8-7c222afa1aeb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:44.256300 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8fdd79f7-03b2-47eb-98c8-7c222afa1aeb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:44.271016 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8fdd79f7-03b2-47eb-98c8-7c222afa1aeb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.207163 Dec 15 19:05:44.271836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 214/444] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:44 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:44.500087 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e5e6b62d-c4cf-40df-8f6a-ad489ed9e615 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:44.500786 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e5e6b62d-c4cf-40df-8f6a-ad489ed9e615 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:44.508129 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e5e6b62d-c4cf-40df-8f6a-ad489ed9e615 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:44.508950 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e5e6b62d-c4cf-40df-8f6a-ad489ed9e615 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:44.510013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e5e6b62d-c4cf-40df-8f6a-ad489ed9e615 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:44.511028 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e5e6b62d-c4cf-40df-8f6a-ad489ed9e615 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:44.952471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e5e6b62d-c4cf-40df-8f6a-ad489ed9e615 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:44.968647 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e5e6b62d-c4cf-40df-8f6a-ad489ed9e615 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.472859 Dec 15 19:05:44.980041 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 231/445] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:44 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:45.288406 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9d805da2-0894-426d-8ee2-dd445591816e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:45.289109 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9d805da2-0894-426d-8ee2-dd445591816e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:45.295427 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9d805da2-0894-426d-8ee2-dd445591816e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:45.295965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9d805da2-0894-426d-8ee2-dd445591816e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:45.296831 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9d805da2-0894-426d-8ee2-dd445591816e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:45.297447 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9d805da2-0894-426d-8ee2-dd445591816e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:45.512865 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9d805da2-0894-426d-8ee2-dd445591816e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:45.523263 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9d805da2-0894-426d-8ee2-dd445591816e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.237123 Dec 15 19:05:45.525795 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 215/446] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:45 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:45.986492 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b955b90d-19c9-4e0b-8496-fb2f3ec01f43 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:45.987720 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b955b90d-19c9-4e0b-8496-fb2f3ec01f43 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:45.994679 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b955b90d-19c9-4e0b-8496-fb2f3ec01f43 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:45.995430 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b955b90d-19c9-4e0b-8496-fb2f3ec01f43 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:45.996413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b955b90d-19c9-4e0b-8496-fb2f3ec01f43 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:45.997052 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b955b90d-19c9-4e0b-8496-fb2f3ec01f43 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:46.162945 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6d2ab1dc-f61f-48d0-966d-1f4ac04cf6fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:46.163900 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6d2ab1dc-f61f-48d0-966d-1f4ac04cf6fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:46.171229 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6d2ab1dc-f61f-48d0-966d-1f4ac04cf6fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:46.171760 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6d2ab1dc-f61f-48d0-966d-1f4ac04cf6fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:46.172829 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6d2ab1dc-f61f-48d0-966d-1f4ac04cf6fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:46.173304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6d2ab1dc-f61f-48d0-966d-1f4ac04cf6fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:46.198130 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-6d2ab1dc-f61f-48d0-966d-1f4ac04cf6fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lazy-loading 'flavor' on Instance uuid 93490542-6e11-41c3-9901-c06a1dd65cef {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:05:46.243371 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b955b90d-19c9-4e0b-8496-fb2f3ec01f43 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:46.256028 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b955b90d-19c9-4e0b-8496-fb2f3ec01f43 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.273274 Dec 15 19:05:46.257437 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 232/447] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:45 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:46.541776 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ddec8f8d-6afe-4c64-9569-8b3a157a2c23 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:46.545202 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ddec8f8d-6afe-4c64-9569-8b3a157a2c23 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:46.568805 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ddec8f8d-6afe-4c64-9569-8b3a157a2c23 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:46.570192 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ddec8f8d-6afe-4c64-9569-8b3a157a2c23 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:46.571025 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ddec8f8d-6afe-4c64-9569-8b3a157a2c23 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:46.571475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ddec8f8d-6afe-4c64-9569-8b3a157a2c23 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:46.969150 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6d2ab1dc-f61f-48d0-966d-1f4ac04cf6fd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 202 len: 0 microversion: 2.20 time: 0.809678 Dec 15 19:05:46.971880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 216/448] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:05:46 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 19:05:47.017036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:47.017036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:47.022787 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:47.025703 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:47.027606 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:47.030155 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:47.294679 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ddec8f8d-6afe-4c64-9569-8b3a157a2c23 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:47.303007 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ddec8f8d-6afe-4c64-9569-8b3a157a2c23 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.765162 Dec 15 19:05:47.306567 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 233/449] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:46 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:47.319721 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a863dd53-237f-4fb9-8774-458fe09444a8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:47.321733 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a863dd53-237f-4fb9-8774-458fe09444a8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:47.333727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a863dd53-237f-4fb9-8774-458fe09444a8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:47.334722 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a863dd53-237f-4fb9-8774-458fe09444a8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:47.338961 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a863dd53-237f-4fb9-8774-458fe09444a8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:47.340534 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a863dd53-237f-4fb9-8774-458fe09444a8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:47.629109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a863dd53-237f-4fb9-8774-458fe09444a8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:47.638323 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a863dd53-237f-4fb9-8774-458fe09444a8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.328151 Dec 15 19:05:47.647894 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 234/450] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:47 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:47.700643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:47.709643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:47.711138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:47.712486 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f1f2f759-b520-4b91-ad75-fa0ef27d4c1c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.735073 Dec 15 19:05:47.713045 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 217/451] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:46 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:05:48.323617 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9bb03ef8-f5b4-43d6-a0eb-f17cfe194aba tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:48.324337 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9bb03ef8-f5b4-43d6-a0eb-f17cfe194aba tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:48.330679 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9bb03ef8-f5b4-43d6-a0eb-f17cfe194aba tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:48.331212 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9bb03ef8-f5b4-43d6-a0eb-f17cfe194aba tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:48.332069 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9bb03ef8-f5b4-43d6-a0eb-f17cfe194aba tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:48.332599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9bb03ef8-f5b4-43d6-a0eb-f17cfe194aba tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:48.471004 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9bb03ef8-f5b4-43d6-a0eb-f17cfe194aba tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:48.478293 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9bb03ef8-f5b4-43d6-a0eb-f17cfe194aba tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.158312 Dec 15 19:05:48.478861 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 235/452] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:48 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:48.655622 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4e53f04b-e59e-4198-91cd-6c669f73589f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:48.656397 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4e53f04b-e59e-4198-91cd-6c669f73589f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:48.664398 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4e53f04b-e59e-4198-91cd-6c669f73589f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:48.669377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4e53f04b-e59e-4198-91cd-6c669f73589f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:48.669377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4e53f04b-e59e-4198-91cd-6c669f73589f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:48.669377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4e53f04b-e59e-4198-91cd-6c669f73589f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:48.732485 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:48.733150 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:48.743364 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:48.744569 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:48.747857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:48.748471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:48.890457 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4e53f04b-e59e-4198-91cd-6c669f73589f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:48.910458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4e53f04b-e59e-4198-91cd-6c669f73589f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.258926 Dec 15 19:05:48.911476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 218/453] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:48 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:49.010162 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:49.026266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:49.027980 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:49.029340 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9cc50acd-aab6-4bcb-a0a4-4bae222efcec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.301523 Dec 15 19:05:49.030606 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 236/454] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:48 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:05:49.497620 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-688bcbd8-b5c9-4fc9-8502-6b745cb402b1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:49.498244 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-688bcbd8-b5c9-4fc9-8502-6b745cb402b1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:49.508856 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-688bcbd8-b5c9-4fc9-8502-6b745cb402b1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:49.509533 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-688bcbd8-b5c9-4fc9-8502-6b745cb402b1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:49.510577 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-688bcbd8-b5c9-4fc9-8502-6b745cb402b1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:49.511231 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-688bcbd8-b5c9-4fc9-8502-6b745cb402b1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:49.852616 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-688bcbd8-b5c9-4fc9-8502-6b745cb402b1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:49.867290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-688bcbd8-b5c9-4fc9-8502-6b745cb402b1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.375081 Dec 15 19:05:49.868801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 219/455] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:49 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:49.936357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5c5cbf6d-45bd-403f-818e-b9436a744edf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:49.936357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5c5cbf6d-45bd-403f-818e-b9436a744edf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:49.944591 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5c5cbf6d-45bd-403f-818e-b9436a744edf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:49.945326 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5c5cbf6d-45bd-403f-818e-b9436a744edf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:49.946328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5c5cbf6d-45bd-403f-818e-b9436a744edf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:49.946736 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5c5cbf6d-45bd-403f-818e-b9436a744edf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:50.056845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:50.058142 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:50.068216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:50.069205 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:50.070152 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:50.070850 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:50.177524 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5c5cbf6d-45bd-403f-818e-b9436a744edf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:50.194007 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5c5cbf6d-45bd-403f-818e-b9436a744edf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.271049 Dec 15 19:05:50.197660 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 237/456] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:49 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:50.348079 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:50.371679 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:50.379730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:50.392326 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3b7ff47b-1596-44a7-b93e-ae543912355b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.339656 Dec 15 19:05:50.393782 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 220/457] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:50 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:05:50.885645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-cb43b490-0c14-411c-ba6f-2e9f738b3e48 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:50.886277 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-cb43b490-0c14-411c-ba6f-2e9f738b3e48 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:50.893339 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cb43b490-0c14-411c-ba6f-2e9f738b3e48 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:50.897998 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cb43b490-0c14-411c-ba6f-2e9f738b3e48 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:50.899121 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cb43b490-0c14-411c-ba6f-2e9f738b3e48 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:50.899765 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cb43b490-0c14-411c-ba6f-2e9f738b3e48 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:51.221734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bc421304-8678-403f-bdce-aec4598c1ee5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:51.223140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bc421304-8678-403f-bdce-aec4598c1ee5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:51.243673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc421304-8678-403f-bdce-aec4598c1ee5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:51.245173 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc421304-8678-403f-bdce-aec4598c1ee5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:51.251636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc421304-8678-403f-bdce-aec4598c1ee5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:51.252155 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc421304-8678-403f-bdce-aec4598c1ee5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:51.508106 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cb43b490-0c14-411c-ba6f-2e9f738b3e48 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:51.523295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-cb43b490-0c14-411c-ba6f-2e9f738b3e48 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.639913 Dec 15 19:05:51.524314 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 238/458] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:50 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:51.530498 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:51.531417 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:51.539404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:51.540041 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:51.540895 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:51.541442 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:51.577434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bc421304-8678-403f-bdce-aec4598c1ee5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:51.593445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bc421304-8678-403f-bdce-aec4598c1ee5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.377437 Dec 15 19:05:51.594053 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 221/459] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:51 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:51.652955 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-ae559dab-744a-427e-b00f-06831980a1d0 req-7a0e1ddb-9220-4c3a-87f0-bc570e2a982b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d9554d-bb60-4d4e-9ab8-311caafb659f", "name": "network-vif-plugged", "status": "completed", "tag": "29640191-71ad-4c57-b1eb-eb8f4de83e2b"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:51.655017 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:05:51.655017 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:05:51.680156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-ae559dab-744a-427e-b00f-06831980a1d0 req-7a0e1ddb-9220-4c3a-87f0-bc570e2a982b service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:51.683154 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-ae559dab-744a-427e-b00f-06831980a1d0 req-7a0e1ddb-9220-4c3a-87f0-bc570e2a982b service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:51.717775 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-ae559dab-744a-427e-b00f-06831980a1d0 req-7a0e1ddb-9220-4c3a-87f0-bc570e2a982b service nova] Creating event network-vif-plugged:29640191-71ad-4c57-b1eb-eb8f4de83e2b for instance 92d9554d-bb60-4d4e-9ab8-311caafb659f on hv-cinder-81268 Dec 15 19:05:51.730862 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-ae559dab-744a-427e-b00f-06831980a1d0 req-7a0e1ddb-9220-4c3a-87f0-bc570e2a982b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079555 Dec 15 19:05:51.731785 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 222/460] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:05:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:05:51.798154 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:51.810630 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:51.818996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:51.822449 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-56a987e0-1c9f-4c17-9656-0813f544de9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.295881 Dec 15 19:05:51.826988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 239/461] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:51 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:05:52.050416 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5eb31a41-baae-4a2b-9d3b-f13abfabcbba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e7a0b86-8850-449f-9c28-0fccabded88c"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:52.051967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5eb31a41-baae-4a2b-9d3b-f13abfabcbba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:52.059574 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5eb31a41-baae-4a2b-9d3b-f13abfabcbba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.060022 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5eb31a41-baae-4a2b-9d3b-f13abfabcbba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.061121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5eb31a41-baae-4a2b-9d3b-f13abfabcbba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.061571 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5eb31a41-baae-4a2b-9d3b-f13abfabcbba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.272653 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-5eb31a41-baae-4a2b-9d3b-f13abfabcbba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] HTTP exception thrown: Invalid volume: volume 9e7a0b86-8850-449f-9c28-0fccabded88c is already attached to instances: eb865707-c2a0-4a91-9c92-70e29b1b2a48 Dec 15 19:05:52.273290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5eb31a41-baae-4a2b-9d3b-f13abfabcbba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Returning 400 to user: Invalid volume: volume 9e7a0b86-8850-449f-9c28-0fccabded88c is already attached to instances: eb865707-c2a0-4a91-9c92-70e29b1b2a48 {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:05:52.274135 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5eb31a41-baae-4a2b-9d3b-f13abfabcbba tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "POST /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.228947 Dec 15 19:05:52.281641 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 223/462] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:05:52 2021] POST /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments => generated 174 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 19:05:52.364994 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7c620374-652e-437e-94a7-fb719d70e56e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:52.365817 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7c620374-652e-437e-94a7-fb719d70e56e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:52.376155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7c620374-652e-437e-94a7-fb719d70e56e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.381457 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7c620374-652e-437e-94a7-fb719d70e56e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.382412 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7c620374-652e-437e-94a7-fb719d70e56e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.383187 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7c620374-652e-437e-94a7-fb719d70e56e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.540005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8217ad5e-8d4a-487f-b254-9595ef5d8ac7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:52.540610 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8217ad5e-8d4a-487f-b254-9595ef5d8ac7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:52.542261 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-7c620374-652e-437e-94a7-fb719d70e56e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lazy-loading 'services' on Instance uuid eb865707-c2a0-4a91-9c92-70e29b1b2a48 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:05:52.548534 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8217ad5e-8d4a-487f-b254-9595ef5d8ac7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.548981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8217ad5e-8d4a-487f-b254-9595ef5d8ac7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.552297 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8217ad5e-8d4a-487f-b254-9595ef5d8ac7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.558933 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8217ad5e-8d4a-487f-b254-9595ef5d8ac7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.719163 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8217ad5e-8d4a-487f-b254-9595ef5d8ac7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:52.727965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8217ad5e-8d4a-487f-b254-9595ef5d8ac7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.191695 Dec 15 19:05:52.728535 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 224/463] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:52 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:52.747277 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a1123512-4760-4078-a3e0-f4316599148d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:52.749318 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a1123512-4760-4078-a3e0-f4316599148d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:52.756596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a1123512-4760-4078-a3e0-f4316599148d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.757043 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a1123512-4760-4078-a3e0-f4316599148d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.757884 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a1123512-4760-4078-a3e0-f4316599148d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.758337 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a1123512-4760-4078-a3e0-f4316599148d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.825210 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7c620374-652e-437e-94a7-fb719d70e56e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments/9e7a0b86-8850-449f-9c28-0fccabded88c" status: 202 len: 0 microversion: 2.1 time: 0.464159 Dec 15 19:05:52.826334 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 240/464] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:05:52 2021] DELETE /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments/9e7a0b86-8850-449f-9c28-0fccabded88c => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:05:52.837878 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b3c4c070-6d36-49d0-b968-65383bf28804 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:52.839151 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b3c4c070-6d36-49d0-b968-65383bf28804 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:52.847346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b3c4c070-6d36-49d0-b968-65383bf28804 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.847980 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b3c4c070-6d36-49d0-b968-65383bf28804 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.855964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b3c4c070-6d36-49d0-b968-65383bf28804 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.856615 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b3c4c070-6d36-49d0-b968-65383bf28804 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.895479 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b3c4c070-6d36-49d0-b968-65383bf28804 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064218 Dec 15 19:05:52.896214 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 241/465] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:05:52 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:05:52.904674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:52.905501 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:52.912020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.912662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.913745 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:52.914323 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:52.920941 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a1123512-4760-4078-a3e0-f4316599148d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:52.935153 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a1123512-4760-4078-a3e0-f4316599148d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.196107 Dec 15 19:05:52.936077 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 225/466] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:52 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:53.229907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:53.238102 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:53.239585 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:53.246662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-101f5331-de94-40b1-8840-6dbbbc66cda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.349229 Dec 15 19:05:53.247284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 242/467] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:52 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:05:53.745745 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2350e118-0631-429d-b740-bb37a96dfd67 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:53.746424 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2350e118-0631-429d-b740-bb37a96dfd67 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:53.754457 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2350e118-0631-429d-b740-bb37a96dfd67 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:53.754912 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2350e118-0631-429d-b740-bb37a96dfd67 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:53.755941 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2350e118-0631-429d-b740-bb37a96dfd67 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:53.756368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2350e118-0631-429d-b740-bb37a96dfd67 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:53.910040 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3d76d4de-3e4f-43c6-a1c0-8569b41fe153 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:53.911007 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3d76d4de-3e4f-43c6-a1c0-8569b41fe153 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:53.931048 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d76d4de-3e4f-43c6-a1c0-8569b41fe153 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:53.934020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d76d4de-3e4f-43c6-a1c0-8569b41fe153 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:53.936191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d76d4de-3e4f-43c6-a1c0-8569b41fe153 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:53.936648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3d76d4de-3e4f-43c6-a1c0-8569b41fe153 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:53.944669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2350e118-0631-429d-b740-bb37a96dfd67 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:53.954417 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2350e118-0631-429d-b740-bb37a96dfd67 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.212731 Dec 15 19:05:53.958575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 226/468] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:53 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:53.967782 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-839aee98-12d2-427c-8165-fbcfc09385e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:53.968403 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-839aee98-12d2-427c-8165-fbcfc09385e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:53.975026 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-839aee98-12d2-427c-8165-fbcfc09385e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:53.975862 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-839aee98-12d2-427c-8165-fbcfc09385e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:53.976849 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-839aee98-12d2-427c-8165-fbcfc09385e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:53.977489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-839aee98-12d2-427c-8165-fbcfc09385e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:54.014507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3d76d4de-3e4f-43c6-a1c0-8569b41fe153 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110411 Dec 15 19:05:54.018952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 243/469] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:05:53 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:05:54.136316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-839aee98-12d2-427c-8165-fbcfc09385e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:54.145764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-839aee98-12d2-427c-8165-fbcfc09385e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1363 microversion: 2.1 time: 0.186057 Dec 15 19:05:54.146484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 227/470] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:53 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:54.270293 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:54.270907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:54.277166 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:54.277716 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:54.281886 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:54.281886 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:54.506549 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:54.514330 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:54.515926 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:54.517846 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-47c9eacb-d670-4292-a3f0-dc6f1c3238da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.253772 Dec 15 19:05:54.518435 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 244/471] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:54 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:05:54.971002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5facd6f2-dbb8-42e4-b1e6-ef4a30a9a3ce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:54.971874 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5facd6f2-dbb8-42e4-b1e6-ef4a30a9a3ce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:54.979174 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5facd6f2-dbb8-42e4-b1e6-ef4a30a9a3ce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:54.979712 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5facd6f2-dbb8-42e4-b1e6-ef4a30a9a3ce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:54.980576 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5facd6f2-dbb8-42e4-b1e6-ef4a30a9a3ce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:54.981108 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5facd6f2-dbb8-42e4-b1e6-ef4a30a9a3ce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.028846 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9c5d3be3-2ac8-4585-b735-d491c9ee0453 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:55.031060 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9c5d3be3-2ac8-4585-b735-d491c9ee0453 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:55.043797 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9c5d3be3-2ac8-4585-b735-d491c9ee0453 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.044255 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9c5d3be3-2ac8-4585-b735-d491c9ee0453 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.045280 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9c5d3be3-2ac8-4585-b735-d491c9ee0453 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.047639 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9c5d3be3-2ac8-4585-b735-d491c9ee0453 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.117988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9c5d3be3-2ac8-4585-b735-d491c9ee0453 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095144 Dec 15 19:05:55.119249 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 245/472] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:05:55 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:05:55.144565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5facd6f2-dbb8-42e4-b1e6-ef4a30a9a3ce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:55.152966 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5facd6f2-dbb8-42e4-b1e6-ef4a30a9a3ce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.185724 Dec 15 19:05:55.163160 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 228/473] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:54 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:55.163267 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6e36ccce-0f59-44f9-bf3d-fad7533dab03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:55.163267 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6e36ccce-0f59-44f9-bf3d-fad7533dab03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:55.171509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e36ccce-0f59-44f9-bf3d-fad7533dab03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.173339 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e36ccce-0f59-44f9-bf3d-fad7533dab03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.174845 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e36ccce-0f59-44f9-bf3d-fad7533dab03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.175467 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e36ccce-0f59-44f9-bf3d-fad7533dab03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.334042 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1189893297", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "networks": [{"uuid": "9b5341ac-959a-4f9c-b267-56c4cfd3994a"}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:55.371888 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6e36ccce-0f59-44f9-bf3d-fad7533dab03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:55.379291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6e36ccce-0f59-44f9-bf3d-fad7533dab03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1548 microversion: 2.1 time: 0.220521 Dec 15 19:05:55.380109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 246/474] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:55 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1548 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:55.395906 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] validate_networks() for [('9b5341ac-959a-4f9c-b267-56c4cfd3994a', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:05:55.396556 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b111b8a7-ba63-43ec-928f-1c685aa5dab0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:55.397256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b111b8a7-ba63-43ec-928f-1c685aa5dab0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:55.404711 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b111b8a7-ba63-43ec-928f-1c685aa5dab0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.405402 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b111b8a7-ba63-43ec-928f-1c685aa5dab0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.407265 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b111b8a7-ba63-43ec-928f-1c685aa5dab0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.407849 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b111b8a7-ba63-43ec-928f-1c685aa5dab0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.581073 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b111b8a7-ba63-43ec-928f-1c685aa5dab0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188099 Dec 15 19:05:55.581903 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 247/475] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Dec 15 19:05:55 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:05:55.588266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:55.590986 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:55.619193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.620331 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.621290 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.625817 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.887135 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:05:55.887554 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:05:55.888095 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:05:55.888493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:05:55.888895 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:05:55.901435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.901978 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.903288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:55.903795 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:55.925279 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Getting quotas for project 52e4764fb4d34d5dbdd967080b99c537. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:05:55.930522 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Getting quotas for user d79566c6c23e4944aadc60c1957cff95 and project 52e4764fb4d34d5dbdd967080b99c537. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:05:55.946876 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:05:55.950737 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:05:56.019172 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:56.032984 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:56.034922 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:56.036169 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3fee4d7f-e5e8-4fee-9c79-c41640e8b4b6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.453555 Dec 15 19:05:56.036766 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 248/476] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:55 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:05:56.072662 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7aaff97f-3efd-4b01-8cf9-c7fcf2181830 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742114 Dec 15 19:05:56.081261 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 229/477] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:05:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:05:56.086411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-13b63731-cfda-4530-b645-832fb2517221 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:56.087032 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-13b63731-cfda-4530-b645-832fb2517221 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:56.171123 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-36fbbc33-52d0-41fa-a1ce-a20adf01e102 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:56.172077 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-36fbbc33-52d0-41fa-a1ce-a20adf01e102 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:56.176604 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-13b63731-cfda-4530-b645-832fb2517221 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:56.180167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-36fbbc33-52d0-41fa-a1ce-a20adf01e102 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:56.180899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-36fbbc33-52d0-41fa-a1ce-a20adf01e102 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:56.182277 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-36fbbc33-52d0-41fa-a1ce-a20adf01e102 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:56.182933 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-36fbbc33-52d0-41fa-a1ce-a20adf01e102 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:56.191864 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-13b63731-cfda-4530-b645-832fb2517221 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1218 microversion: 2.1 time: 0.109233 Dec 15 19:05:56.210812 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 249/478] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:56 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:56.357475 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-36fbbc33-52d0-41fa-a1ce-a20adf01e102 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:56.366575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-36fbbc33-52d0-41fa-a1ce-a20adf01e102 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.199860 Dec 15 19:05:56.375035 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 230/479] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:56 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:57.054771 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:57.055448 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:57.064183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:57.064749 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:57.066143 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:57.066143 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:57.210666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1f687948-9d7a-4f07-aa6e-933537c46708 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:57.211996 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1f687948-9d7a-4f07-aa6e-933537c46708 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:57.219025 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f687948-9d7a-4f07-aa6e-933537c46708 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:57.219478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f687948-9d7a-4f07-aa6e-933537c46708 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:57.220301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f687948-9d7a-4f07-aa6e-933537c46708 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:57.220737 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f687948-9d7a-4f07-aa6e-933537c46708 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:57.303673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1f687948-9d7a-4f07-aa6e-933537c46708 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:57.312107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1f687948-9d7a-4f07-aa6e-933537c46708 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1222 microversion: 2.1 time: 0.105243 Dec 15 19:05:57.324549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 231/480] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:57 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:57.383653 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f4d3baed-d3bd-499d-a489-a4e83758f5f1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:57.384256 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f4d3baed-d3bd-499d-a489-a4e83758f5f1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:57.391789 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f4d3baed-d3bd-499d-a489-a4e83758f5f1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:57.392443 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f4d3baed-d3bd-499d-a489-a4e83758f5f1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:57.396921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f4d3baed-d3bd-499d-a489-a4e83758f5f1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:57.396921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f4d3baed-d3bd-499d-a489-a4e83758f5f1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:57.397142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:57.410092 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:57.412782 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:57.415330 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f985a135-03b3-4c29-877e-b946e515351b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.364773 Dec 15 19:05:57.418943 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 250/481] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:57 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:05:57.555192 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f4d3baed-d3bd-499d-a489-a4e83758f5f1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:57.563417 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f4d3baed-d3bd-499d-a489-a4e83758f5f1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.183075 Dec 15 19:05:57.564810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 232/482] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:57 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:57.647072 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4fb43389-8fd0-474c-ae3f-4d064115c293 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Action: 'create', calling method: .version_select at 0x7f80b5b3d8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-782438899"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:57.661906 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4fb43389-8fd0-474c-ae3f-4d064115c293 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:05:57.665909 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4fb43389-8fd0-474c-ae3f-4d064115c293 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for user b7c21b8f3da14074949d2f6ba58b7204 and project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:05:57.736827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a231f879-efe6-426d-b62a-d5ede30e6be9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:57.737848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a231f879-efe6-426d-b62a-d5ede30e6be9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:57.745237 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a231f879-efe6-426d-b62a-d5ede30e6be9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:57.745779 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a231f879-efe6-426d-b62a-d5ede30e6be9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:57.746691 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a231f879-efe6-426d-b62a-d5ede30e6be9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:57.747400 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a231f879-efe6-426d-b62a-d5ede30e6be9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:57.840149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a231f879-efe6-426d-b62a-d5ede30e6be9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 0.106317 Dec 15 19:05:57.841455 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 233/483] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:05:57 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 19:05:57.846780 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-827a5d26-ce54-437b-afa2-13ce1c9be0b5 req-9aa2f2c7-f51a-4590-8ca9-cd56ef92d43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92d9554d-bb60-4d4e-9ab8-311caafb659f", "tag": "29640191-71ad-4c57-b1eb-eb8f4de83e2b"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:57.848613 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:05:57.848613 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:05:57.857007 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-827a5d26-ce54-437b-afa2-13ce1c9be0b5 req-9aa2f2c7-f51a-4590-8ca9-cd56ef92d43a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:57.857889 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-827a5d26-ce54-437b-afa2-13ce1c9be0b5 req-9aa2f2c7-f51a-4590-8ca9-cd56ef92d43a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:57.859904 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4fb43389-8fd0-474c-ae3f-4d064115c293 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:05:57.865131 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4fb43389-8fd0-474c-ae3f-4d064115c293 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for user b7c21b8f3da14074949d2f6ba58b7204 and project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:05:57.870830 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-827a5d26-ce54-437b-afa2-13ce1c9be0b5 req-9aa2f2c7-f51a-4590-8ca9-cd56ef92d43a service nova] Creating event network-changed:29640191-71ad-4c57-b1eb-eb8f4de83e2b for instance 92d9554d-bb60-4d4e-9ab8-311caafb659f on hv-cinder-81268 Dec 15 19:05:57.876837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-827a5d26-ce54-437b-afa2-13ce1c9be0b5 req-9aa2f2c7-f51a-4590-8ca9-cd56ef92d43a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033803 Dec 15 19:05:57.878124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 234/484] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:05:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:05:57.891854 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4fb43389-8fd0-474c-ae3f-4d064115c293 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.467706 Dec 15 19:05:57.892467 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 251/485] 10.222.0.49 () {60 vars in 1157 bytes} [Wed Dec 15 19:05:57 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:58.332869 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bf7ebafe-7431-4449-accd-c1d37af44d0e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:58.334182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bf7ebafe-7431-4449-accd-c1d37af44d0e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:58.340421 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf7ebafe-7431-4449-accd-c1d37af44d0e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:58.341271 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf7ebafe-7431-4449-accd-c1d37af44d0e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:58.342263 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf7ebafe-7431-4449-accd-c1d37af44d0e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:58.342845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf7ebafe-7431-4449-accd-c1d37af44d0e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:58.411353 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bf7ebafe-7431-4449-accd-c1d37af44d0e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:58.420658 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bf7ebafe-7431-4449-accd-c1d37af44d0e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1270 microversion: 2.1 time: 0.092297 Dec 15 19:05:58.422803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 235/486] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:58 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:58.435759 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:58.438304 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:58.453583 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:58.454397 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:58.455478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:58.456235 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:58.582245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-47febf27-83b3-4383-8ffa-62f1d198ec27 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:58.583234 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-47febf27-83b3-4383-8ffa-62f1d198ec27 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:58.590040 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-47febf27-83b3-4383-8ffa-62f1d198ec27 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:58.590887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-47febf27-83b3-4383-8ffa-62f1d198ec27 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:58.592038 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-47febf27-83b3-4383-8ffa-62f1d198ec27 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:58.592633 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-47febf27-83b3-4383-8ffa-62f1d198ec27 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:58.679942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:58.689831 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:58.693827 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:58.695289 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-531cf0e3-eab6-4128-aa44-87afe84d682e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.263731 Dec 15 19:05:58.709219 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 252/487] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:58 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:05:58.827463 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-47febf27-83b3-4383-8ffa-62f1d198ec27 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:58.841302 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-47febf27-83b3-4383-8ffa-62f1d198ec27 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.263474 Dec 15 19:05:58.843374 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 236/488] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:58 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:05:58.859078 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a714d0f5-be5a-4c3c-b387-a57a5578a659 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:05:58.860962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a714d0f5-be5a-4c3c-b387-a57a5578a659 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:58.869717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a714d0f5-be5a-4c3c-b387-a57a5578a659 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:58.870458 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a714d0f5-be5a-4c3c-b387-a57a5578a659 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:58.871476 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a714d0f5-be5a-4c3c-b387-a57a5578a659 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:58.872132 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a714d0f5-be5a-4c3c-b387-a57a5578a659 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:58.986607 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a714d0f5-be5a-4c3c-b387-a57a5578a659 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 0.133283 Dec 15 19:05:58.988051 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 253/489] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:05:58 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 19:05:59.443973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d998cf70-d671-48b9-b9c7-6141fbaf9dd6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:59.444597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d998cf70-d671-48b9-b9c7-6141fbaf9dd6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:59.454882 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d998cf70-d671-48b9-b9c7-6141fbaf9dd6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:59.455330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d998cf70-d671-48b9-b9c7-6141fbaf9dd6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:59.456145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d998cf70-d671-48b9-b9c7-6141fbaf9dd6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:59.456565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d998cf70-d671-48b9-b9c7-6141fbaf9dd6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:59.581722 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d998cf70-d671-48b9-b9c7-6141fbaf9dd6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:05:59.603397 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d998cf70-d671-48b9-b9c7-6141fbaf9dd6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1278 microversion: 2.1 time: 0.159607 Dec 15 19:05:59.604564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 237/490] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:59 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:05:59.715955 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:59.716654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:59.726481 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:59.727287 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:59.728376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:59.729026 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:59.859285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5f25eb80-3ad0-4670-8f9c-bba4f8b5d0b9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:05:59.859897 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5f25eb80-3ad0-4670-8f9c-bba4f8b5d0b9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:05:59.873569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f25eb80-3ad0-4670-8f9c-bba4f8b5d0b9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:59.873569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f25eb80-3ad0-4670-8f9c-bba4f8b5d0b9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:05:59.873569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f25eb80-3ad0-4670-8f9c-bba4f8b5d0b9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:05:59.873569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f25eb80-3ad0-4670-8f9c-bba4f8b5d0b9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:00.026741 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:00.038083 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:00.040610 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:00.043602 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4667257c-a63f-42d7-a815-ae5963b3769b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.331673 Dec 15 19:06:00.044806 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 254/491] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:05:59 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:00.052559 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d3910b87-54df-41a4-b949-3e2fddcd4684 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:00.053465 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d3910b87-54df-41a4-b949-3e2fddcd4684 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:00.061377 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3910b87-54df-41a4-b949-3e2fddcd4684 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:00.062228 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3910b87-54df-41a4-b949-3e2fddcd4684 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:00.063916 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3910b87-54df-41a4-b949-3e2fddcd4684 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:00.064507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3910b87-54df-41a4-b949-3e2fddcd4684 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:00.094671 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5f25eb80-3ad0-4670-8f9c-bba4f8b5d0b9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:00.106553 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5f25eb80-3ad0-4670-8f9c-bba4f8b5d0b9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.251074 Dec 15 19:06:00.121654 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 238/492] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:05:59 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:00.626339 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ef16ebdc-6fb8-418e-baf7-4299ad133d7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:00.626994 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ef16ebdc-6fb8-418e-baf7-4299ad133d7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:00.633210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef16ebdc-6fb8-418e-baf7-4299ad133d7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:00.633666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef16ebdc-6fb8-418e-baf7-4299ad133d7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:00.634457 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef16ebdc-6fb8-418e-baf7-4299ad133d7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:00.635057 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef16ebdc-6fb8-418e-baf7-4299ad133d7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:00.787684 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ef16ebdc-6fb8-418e-baf7-4299ad133d7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:00.795886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ef16ebdc-6fb8-418e-baf7-4299ad133d7a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.173668 Dec 15 19:06:00.796609 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 239/493] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:00 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:00.874658 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d9abced2-c395-4722-885e-35575eac36dd tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69c3e4e7-1790-4bea-9ab8-a1909ea08d2a", "device": "/dev/sdb"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:00.876863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d9abced2-c395-4722-885e-35575eac36dd tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:00.883107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9abced2-c395-4722-885e-35575eac36dd tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:00.883596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9abced2-c395-4722-885e-35575eac36dd tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:00.884376 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9abced2-c395-4722-885e-35575eac36dd tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:00.884812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9abced2-c395-4722-885e-35575eac36dd tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:03.447948 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d3910b87-54df-41a4-b949-3e2fddcd4684 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 3.401567 Dec 15 19:06:03.448530 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 255/494] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:00 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 3403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:06:03.454387 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:03.455135 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:03.463567 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:03.464231 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:03.465408 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:03.466205 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:03.742040 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:03.749993 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:03.752158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:03.753872 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-07c76ac5-3a4f-4f8c-bc7f-1e58f3c5a369 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.303914 Dec 15 19:06:03.754892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 256/495] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:03 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:03.759509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d8d6d1cd-d7e0-4790-8764-320b85532891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:03.760103 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d8d6d1cd-d7e0-4790-8764-320b85532891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:03.766486 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8d6d1cd-d7e0-4790-8764-320b85532891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:03.766944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8d6d1cd-d7e0-4790-8764-320b85532891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:03.767728 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8d6d1cd-d7e0-4790-8764-320b85532891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:03.768224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d8d6d1cd-d7e0-4790-8764-320b85532891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:04.112949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d9abced2-c395-4722-885e-35575eac36dd tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "POST /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.242222 Dec 15 19:06:04.113781 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 240/496] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:06:00 2021] POST /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3/os-volume_attachments => generated 194 bytes in 3244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:04.119190 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8df93b76-ba31-4f7c-8090-24ad0229fb76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:04.119896 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8df93b76-ba31-4f7c-8090-24ad0229fb76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:04.127645 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8df93b76-ba31-4f7c-8090-24ad0229fb76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:04.128284 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8df93b76-ba31-4f7c-8090-24ad0229fb76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:04.129293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8df93b76-ba31-4f7c-8090-24ad0229fb76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:04.130330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8df93b76-ba31-4f7c-8090-24ad0229fb76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:04.237670 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d8d6d1cd-d7e0-4790-8764-320b85532891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:04.249075 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d8d6d1cd-d7e0-4790-8764-320b85532891 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.492765 Dec 15 19:06:04.250773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 257/497] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:03 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:04.300152 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8df93b76-ba31-4f7c-8090-24ad0229fb76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:04.308069 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8df93b76-ba31-4f7c-8090-24ad0229fb76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.192832 Dec 15 19:06:04.308631 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 241/498] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:04 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:04.459066 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ecacf540-93fb-4c47-a92d-4fd419a7c685 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:04.460389 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ecacf540-93fb-4c47-a92d-4fd419a7c685 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:04.466967 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ecacf540-93fb-4c47-a92d-4fd419a7c685 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:04.467536 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ecacf540-93fb-4c47-a92d-4fd419a7c685 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:04.468565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ecacf540-93fb-4c47-a92d-4fd419a7c685 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:04.469949 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ecacf540-93fb-4c47-a92d-4fd419a7c685 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:04.567091 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ecacf540-93fb-4c47-a92d-4fd419a7c685 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 0.111643 Dec 15 19:06:04.567739 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 258/499] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:04 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:06:04.665680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-41b2e29d-57c3-4891-b037-1ce855fd092c req-de3edbef-2155-42c5-85ff-ea71ffe1e110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75af622f-27d3-45a3-8cd5-c58be636bf58", "tag": "ccb93599-d69e-4dee-a1b0-4b565ff2cdda"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:04.667515 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:06:04.667515 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:06:04.674809 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-41b2e29d-57c3-4891-b037-1ce855fd092c req-de3edbef-2155-42c5-85ff-ea71ffe1e110 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:04.675251 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-41b2e29d-57c3-4891-b037-1ce855fd092c req-de3edbef-2155-42c5-85ff-ea71ffe1e110 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:04.686191 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-41b2e29d-57c3-4891-b037-1ce855fd092c req-de3edbef-2155-42c5-85ff-ea71ffe1e110 service nova] Creating event network-changed:ccb93599-d69e-4dee-a1b0-4b565ff2cdda for instance 75af622f-27d3-45a3-8cd5-c58be636bf58 on hv-cinder-81268 Dec 15 19:06:04.690912 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-41b2e29d-57c3-4891-b037-1ce855fd092c req-de3edbef-2155-42c5-85ff-ea71ffe1e110 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032217 Dec 15 19:06:04.691621 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 242/500] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:06:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:04.774262 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:04.775165 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:04.784203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:04.784664 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:04.785504 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:04.785941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:04.992049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:04.999865 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:05.001942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:05.003076 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5d4c4a23-96ec-43f0-91a5-3b8ff8876d36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.233548 Dec 15 19:06:05.003642 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 259/501] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:04 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:05.266910 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-38235b7e-34c1-4579-8489-7afc1e73b620 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:05.268051 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-38235b7e-34c1-4579-8489-7afc1e73b620 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:05.274616 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-38235b7e-34c1-4579-8489-7afc1e73b620 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.275093 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-38235b7e-34c1-4579-8489-7afc1e73b620 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.276041 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-38235b7e-34c1-4579-8489-7afc1e73b620 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.276484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-38235b7e-34c1-4579-8489-7afc1e73b620 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.324078 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-03b343cc-a88e-464a-a821-7de8a0d9b689 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:05.324685 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-03b343cc-a88e-464a-a821-7de8a0d9b689 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:05.331517 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-03b343cc-a88e-464a-a821-7de8a0d9b689 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.332089 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-03b343cc-a88e-464a-a821-7de8a0d9b689 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.332758 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-03b343cc-a88e-464a-a821-7de8a0d9b689 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.333224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-03b343cc-a88e-464a-a821-7de8a0d9b689 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.415045 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-38235b7e-34c1-4579-8489-7afc1e73b620 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:05.422611 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-38235b7e-34c1-4579-8489-7afc1e73b620 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1501 microversion: 2.1 time: 0.160187 Dec 15 19:06:05.423178 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 243/502] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:05 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:05.438718 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bf6e5efc-e263-441c-8396-d7c7d50870f7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4dced56-7bfa-4721-945e-c6658665d076"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:05.439813 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bf6e5efc-e263-441c-8396-d7c7d50870f7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:05.445572 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf6e5efc-e263-441c-8396-d7c7d50870f7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.446023 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf6e5efc-e263-441c-8396-d7c7d50870f7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.446795 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf6e5efc-e263-441c-8396-d7c7d50870f7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.447235 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf6e5efc-e263-441c-8396-d7c7d50870f7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.477397 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-bf6e5efc-e263-441c-8396-d7c7d50870f7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] HTTP exception thrown: Cannot 'attach_volume' instance 93f130e2-e041-400a-934f-9c837ba505ef while it is in vm_state rescued Dec 15 19:06:05.477990 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bf6e5efc-e263-441c-8396-d7c7d50870f7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Returning 409 to user: Cannot 'attach_volume' instance 93f130e2-e041-400a-934f-9c837ba505ef while it is in vm_state rescued {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:06:05.478861 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bf6e5efc-e263-441c-8396-d7c7d50870f7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043893 Dec 15 19:06:05.479739 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 244/503] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:06:05 2021] POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 15 19:06:05.487970 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2b610c72-58d7-46c1-b1d1-2cf75ab9896c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:05.488499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2b610c72-58d7-46c1-b1d1-2cf75ab9896c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:05.494602 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b610c72-58d7-46c1-b1d1-2cf75ab9896c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.495159 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b610c72-58d7-46c1-b1d1-2cf75ab9896c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.495948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b610c72-58d7-46c1-b1d1-2cf75ab9896c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.496395 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b610c72-58d7-46c1-b1d1-2cf75ab9896c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.566169 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-03b343cc-a88e-464a-a821-7de8a0d9b689 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:05.574013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-03b343cc-a88e-464a-a821-7de8a0d9b689 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.253729 Dec 15 19:06:05.574659 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 260/504] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:05 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:05.580230 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b956df44-d033-479f-b1fb-7ffbe1bf9971 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:05.585789 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b956df44-d033-479f-b1fb-7ffbe1bf9971 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:05.588958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b956df44-d033-479f-b1fb-7ffbe1bf9971 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.589435 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b956df44-d033-479f-b1fb-7ffbe1bf9971 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.590226 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b956df44-d033-479f-b1fb-7ffbe1bf9971 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.590667 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b956df44-d033-479f-b1fb-7ffbe1bf9971 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.669798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b956df44-d033-479f-b1fb-7ffbe1bf9971 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 0.093542 Dec 15 19:06:05.670553 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 261/505] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:05 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:06:05.711159 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2b610c72-58d7-46c1-b1d1-2cf75ab9896c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/action" status: 202 len: 0 microversion: 2.1 time: 0.226839 Dec 15 19:06:05.711805 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 245/506] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:05 2021] POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:06:05.720375 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fe029caf-7582-4bf7-a91d-d225f46a1d53 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:05.721070 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fe029caf-7582-4bf7-a91d-d225f46a1d53 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:05.728163 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fe029caf-7582-4bf7-a91d-d225f46a1d53 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.728617 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fe029caf-7582-4bf7-a91d-d225f46a1d53 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.729499 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fe029caf-7582-4bf7-a91d-d225f46a1d53 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:05.729935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fe029caf-7582-4bf7-a91d-d225f46a1d53 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:05.896633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fe029caf-7582-4bf7-a91d-d225f46a1d53 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:05.904044 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fe029caf-7582-4bf7-a91d-d225f46a1d53 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1509 microversion: 2.1 time: 0.187841 Dec 15 19:06:05.904889 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 262/507] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:05 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:06.022851 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:06.023550 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:06.029673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:06.030134 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:06.030919 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:06.031370 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:06.165914 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:06.175198 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:06.176705 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:06.177917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-34a35e51-12d4-43da-bcc9-e5d5ef352aa2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.159314 Dec 15 19:06:06.181124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 246/508] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:06 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:06.590737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9371f758-14f0-431c-a315-50343c9eb1a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:06.591395 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9371f758-14f0-431c-a315-50343c9eb1a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:06.599261 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9371f758-14f0-431c-a315-50343c9eb1a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:06.599714 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9371f758-14f0-431c-a315-50343c9eb1a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:06.600506 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9371f758-14f0-431c-a315-50343c9eb1a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:06.600942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9371f758-14f0-431c-a315-50343c9eb1a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:06.679957 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b7be0fee-c3dc-4167-b967-64c54acc25ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:06.680897 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b7be0fee-c3dc-4167-b967-64c54acc25ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:06.687692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7be0fee-c3dc-4167-b967-64c54acc25ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:06.688458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7be0fee-c3dc-4167-b967-64c54acc25ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:06.689572 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7be0fee-c3dc-4167-b967-64c54acc25ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:06.690121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7be0fee-c3dc-4167-b967-64c54acc25ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:06.740291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9371f758-14f0-431c-a315-50343c9eb1a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:06.747780 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9371f758-14f0-431c-a315-50343c9eb1a5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.161007 Dec 15 19:06:06.748352 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 263/509] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:06 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:06.800775 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b7be0fee-c3dc-4167-b967-64c54acc25ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 0.124420 Dec 15 19:06:06.801435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 247/510] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:06 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 19:06:06.922160 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-97216262-40bb-48aa-a7c2-20983fcef73a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:06.922922 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-97216262-40bb-48aa-a7c2-20983fcef73a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:06.929303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-97216262-40bb-48aa-a7c2-20983fcef73a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:06.929747 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-97216262-40bb-48aa-a7c2-20983fcef73a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:06.930546 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-97216262-40bb-48aa-a7c2-20983fcef73a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:06.930982 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-97216262-40bb-48aa-a7c2-20983fcef73a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:07.067745 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-97216262-40bb-48aa-a7c2-20983fcef73a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:07.075020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-97216262-40bb-48aa-a7c2-20983fcef73a tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1509 microversion: 2.1 time: 0.156715 Dec 15 19:06:07.075578 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 264/511] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:06 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:07.197131 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:07.197865 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:07.205200 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:07.205645 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:07.206432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:07.206860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:07.355869 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:07.362917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:07.364304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:07.365475 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-113fb1d8-1dff-47cb-b748-e9d035976fc1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.172370 Dec 15 19:06:07.377385 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 248/512] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:07 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:07.765106 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c367acc5-2c30-41ec-bad4-4572008e7bd3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:07.765735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c367acc5-2c30-41ec-bad4-4572008e7bd3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:07.771943 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c367acc5-2c30-41ec-bad4-4572008e7bd3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:07.772388 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c367acc5-2c30-41ec-bad4-4572008e7bd3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:07.773191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c367acc5-2c30-41ec-bad4-4572008e7bd3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:07.773624 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c367acc5-2c30-41ec-bad4-4572008e7bd3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:07.811357 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8db9e3d2-eeff-4a28-8627-a76b18808a0d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:07.813591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8db9e3d2-eeff-4a28-8627-a76b18808a0d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:07.820816 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8db9e3d2-eeff-4a28-8627-a76b18808a0d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:07.821585 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8db9e3d2-eeff-4a28-8627-a76b18808a0d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:07.822351 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8db9e3d2-eeff-4a28-8627-a76b18808a0d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:07.822777 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8db9e3d2-eeff-4a28-8627-a76b18808a0d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:07.908818 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8db9e3d2-eeff-4a28-8627-a76b18808a0d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 0.100445 Dec 15 19:06:07.909799 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 249/513] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:07 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 19:06:07.919514 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c367acc5-2c30-41ec-bad4-4572008e7bd3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:07.927852 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c367acc5-2c30-41ec-bad4-4572008e7bd3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.166418 Dec 15 19:06:07.928428 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 265/514] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:07 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:08.097478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3dca5a88-951b-4a50-a6c9-b3f858e55684 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:08.098170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3dca5a88-951b-4a50-a6c9-b3f858e55684 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:08.105159 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3dca5a88-951b-4a50-a6c9-b3f858e55684 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:08.105610 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3dca5a88-951b-4a50-a6c9-b3f858e55684 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:08.106400 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3dca5a88-951b-4a50-a6c9-b3f858e55684 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:08.106843 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3dca5a88-951b-4a50-a6c9-b3f858e55684 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:08.235140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3dca5a88-951b-4a50-a6c9-b3f858e55684 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:08.243575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3dca5a88-951b-4a50-a6c9-b3f858e55684 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1509 microversion: 2.1 time: 0.150662 Dec 15 19:06:08.244143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 250/515] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:08 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:08.384641 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:08.385271 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:08.392252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:08.392703 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:08.393528 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:08.393957 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:08.526893 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:08.535295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:08.536791 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:08.537971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3e5a79ed-35a5-4056-8081-8b548113d458 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1739 microversion: 2.20 time: 0.157112 Dec 15 19:06:08.538898 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 266/516] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:08 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:08.919551 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f1bb56d3-369a-4616-84bd-f5a24178fc65 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:08.920621 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f1bb56d3-369a-4616-84bd-f5a24178fc65 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:08.927001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f1bb56d3-369a-4616-84bd-f5a24178fc65 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:08.927440 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f1bb56d3-369a-4616-84bd-f5a24178fc65 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:08.928214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f1bb56d3-369a-4616-84bd-f5a24178fc65 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:08.928645 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f1bb56d3-369a-4616-84bd-f5a24178fc65 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:08.945255 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0056efc2-14bd-4224-b334-eaabd5332cf0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:08.945992 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0056efc2-14bd-4224-b334-eaabd5332cf0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:08.952264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0056efc2-14bd-4224-b334-eaabd5332cf0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:08.952712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0056efc2-14bd-4224-b334-eaabd5332cf0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:08.953691 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0056efc2-14bd-4224-b334-eaabd5332cf0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:08.954782 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0056efc2-14bd-4224-b334-eaabd5332cf0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:09.000306 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f1bb56d3-369a-4616-84bd-f5a24178fc65 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 0.084225 Dec 15 19:06:09.001118 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 251/517] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:08 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:06:09.094328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0056efc2-14bd-4224-b334-eaabd5332cf0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:09.104880 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0056efc2-14bd-4224-b334-eaabd5332cf0 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.163218 Dec 15 19:06:09.105537 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 267/518] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:08 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:09.260975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4074fe03-8ec9-4d23-b3a0-9744e6bdefab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:09.261757 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4074fe03-8ec9-4d23-b3a0-9744e6bdefab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:09.268724 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4074fe03-8ec9-4d23-b3a0-9744e6bdefab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:09.269177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4074fe03-8ec9-4d23-b3a0-9744e6bdefab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:09.269951 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4074fe03-8ec9-4d23-b3a0-9744e6bdefab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:09.270378 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4074fe03-8ec9-4d23-b3a0-9744e6bdefab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:09.411348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4074fe03-8ec9-4d23-b3a0-9744e6bdefab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:09.418655 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4074fe03-8ec9-4d23-b3a0-9744e6bdefab tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1515 microversion: 2.1 time: 0.161608 Dec 15 19:06:09.419207 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 252/519] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:09 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:09.556523 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:09.557167 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:09.567876 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:09.568309 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:09.569137 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:09.569578 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:09.710508 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:09.718637 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:09.720843 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:09.722008 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-36ba45a2-5f50-4395-8aba-dd595c9a08c2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1739 microversion: 2.20 time: 0.169280 Dec 15 19:06:09.723527 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 268/520] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:09 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:10.011758 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ccc9ed5a-d099-4652-a0b0-6fb636176758 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:10.012691 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ccc9ed5a-d099-4652-a0b0-6fb636176758 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:10.019632 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ccc9ed5a-d099-4652-a0b0-6fb636176758 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:10.020090 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ccc9ed5a-d099-4652-a0b0-6fb636176758 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:10.020959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ccc9ed5a-d099-4652-a0b0-6fb636176758 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:10.021361 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ccc9ed5a-d099-4652-a0b0-6fb636176758 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:10.121873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-44c62d4f-4746-42ea-8ae6-2765507d5b2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:10.122475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-44c62d4f-4746-42ea-8ae6-2765507d5b2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:10.129244 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-44c62d4f-4746-42ea-8ae6-2765507d5b2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:10.133460 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-44c62d4f-4746-42ea-8ae6-2765507d5b2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:10.133460 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-44c62d4f-4746-42ea-8ae6-2765507d5b2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:10.133460 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-44c62d4f-4746-42ea-8ae6-2765507d5b2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:10.263942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-44c62d4f-4746-42ea-8ae6-2765507d5b2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:10.271609 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-44c62d4f-4746-42ea-8ae6-2765507d5b2c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.153431 Dec 15 19:06:10.272186 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 269/521] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:10 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:10.740972 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:10.741642 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:10.747431 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:10.747869 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:10.748637 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:10.749256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:10.874805 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:10.883437 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:10.884937 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:10.886119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f49c404a-a231-4d56-b156-2ced6e564416 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1739 microversion: 2.20 time: 0.148918 Dec 15 19:06:10.886680 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 270/522] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:10 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:11.288974 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-dfad05c5-1c63-4b1c-b100-69daf07c25ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:11.289828 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-dfad05c5-1c63-4b1c-b100-69daf07c25ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:11.296361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dfad05c5-1c63-4b1c-b100-69daf07c25ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:11.296820 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dfad05c5-1c63-4b1c-b100-69daf07c25ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:11.297653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dfad05c5-1c63-4b1c-b100-69daf07c25ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:11.298091 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dfad05c5-1c63-4b1c-b100-69daf07c25ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:11.427263 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-dfad05c5-1c63-4b1c-b100-69daf07c25ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:11.434341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-dfad05c5-1c63-4b1c-b100-69daf07c25ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.149056 Dec 15 19:06:11.434902 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 271/523] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:11 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:11.904069 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:11.904596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:11.910300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:11.910779 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:11.911544 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:11.912001 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:12.039236 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:12.046944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:12.048939 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:12.050148 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-cf2fffdd-c40a-4988-abdf-82e0c59efddb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1739 microversion: 2.20 time: 0.149891 Dec 15 19:06:12.050730 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 272/524] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:11 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:12.450943 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1f3b7a03-75b2-4e2a-94de-dedbd9d9e519 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:12.451604 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1f3b7a03-75b2-4e2a-94de-dedbd9d9e519 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:12.457867 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1f3b7a03-75b2-4e2a-94de-dedbd9d9e519 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:12.458316 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1f3b7a03-75b2-4e2a-94de-dedbd9d9e519 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:12.459097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1f3b7a03-75b2-4e2a-94de-dedbd9d9e519 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:12.459535 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1f3b7a03-75b2-4e2a-94de-dedbd9d9e519 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:12.585831 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1f3b7a03-75b2-4e2a-94de-dedbd9d9e519 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:12.593000 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1f3b7a03-75b2-4e2a-94de-dedbd9d9e519 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.145700 Dec 15 19:06:12.593657 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 273/525] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:12 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:13.067763 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:13.082280 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:13.083190 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ccc9ed5a-d099-4652-a0b0-6fb636176758 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 3.065141 Dec 15 19:06:13.083190 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 253/526] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:10 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 3067 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:06:13.083613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:13.083613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:13.083613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:13.083613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:13.211661 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:13.219816 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:13.221447 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:13.225296 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5ccc5ddb-2545-4beb-8a9f-7da06b935e1d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1739 microversion: 2.20 time: 0.158664 Dec 15 19:06:13.225296 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 274/527] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:13 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:13.611669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b500031b-4f57-427f-a273-df7f1b518883 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:13.612279 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b500031b-4f57-427f-a273-df7f1b518883 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:13.619600 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b500031b-4f57-427f-a273-df7f1b518883 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:13.620054 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b500031b-4f57-427f-a273-df7f1b518883 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:13.620919 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b500031b-4f57-427f-a273-df7f1b518883 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:13.621383 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b500031b-4f57-427f-a273-df7f1b518883 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:13.761331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b500031b-4f57-427f-a273-df7f1b518883 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:13.768813 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b500031b-4f57-427f-a273-df7f1b518883 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.162036 Dec 15 19:06:13.769417 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 254/528] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:13 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:14.084401 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-36e770a6-ad08-43bb-8e7b-b66f3f1ee398 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:14.085451 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-36e770a6-ad08-43bb-8e7b-b66f3f1ee398 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:14.091633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-36e770a6-ad08-43bb-8e7b-b66f3f1ee398 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.092086 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-36e770a6-ad08-43bb-8e7b-b66f3f1ee398 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:14.092864 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-36e770a6-ad08-43bb-8e7b-b66f3f1ee398 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.093337 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-36e770a6-ad08-43bb-8e7b-b66f3f1ee398 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:14.177271 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5c028cbc-2990-4b21-bad6-32e98438164e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:14.177881 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5c028cbc-2990-4b21-bad6-32e98438164e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:14.184182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5c028cbc-2990-4b21-bad6-32e98438164e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.184754 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5c028cbc-2990-4b21-bad6-32e98438164e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:14.185628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5c028cbc-2990-4b21-bad6-32e98438164e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.185923 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5c028cbc-2990-4b21-bad6-32e98438164e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:14.207309 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-36e770a6-ad08-43bb-8e7b-b66f3f1ee398 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 0.125145 Dec 15 19:06:14.212297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 275/529] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:14 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:06:14.241132 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:14.241824 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:14.248653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.249196 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:14.249900 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.250328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:14.332793 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5c028cbc-2990-4b21-bad6-32e98438164e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:14.341176 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5c028cbc-2990-4b21-bad6-32e98438164e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1515 microversion: 2.1 time: 0.168121 Dec 15 19:06:14.341755 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 255/530] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:14 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:14.361810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e5d559bb-0976-4be3-980e-baf6eb185812 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f716fec-ed87-47fe-8800-55099d62e383"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:14.362532 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e5d559bb-0976-4be3-980e-baf6eb185812 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:14.370343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e5d559bb-0976-4be3-980e-baf6eb185812 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.370806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e5d559bb-0976-4be3-980e-baf6eb185812 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:14.371598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e5d559bb-0976-4be3-980e-baf6eb185812 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.372034 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e5d559bb-0976-4be3-980e-baf6eb185812 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:14.418515 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:14.427056 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:14.428567 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:14.430019 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-78fae4c9-25c3-4aba-bed5-55fc4b237dcf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.193121 Dec 15 19:06:14.430737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 276/531] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:14 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:14.787369 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-23f12e1c-9824-460e-861a-3507c842f351 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:14.790750 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-23f12e1c-9824-460e-861a-3507c842f351 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:14.801838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23f12e1c-9824-460e-861a-3507c842f351 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.802526 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23f12e1c-9824-460e-861a-3507c842f351 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:14.803555 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23f12e1c-9824-460e-861a-3507c842f351 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:14.804176 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23f12e1c-9824-460e-861a-3507c842f351 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:15.008191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-23f12e1c-9824-460e-861a-3507c842f351 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:15.016836 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-23f12e1c-9824-460e-861a-3507c842f351 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.233151 Dec 15 19:06:15.026675 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 277/532] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:14 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:15.220199 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9bc0ddff-5870-4025-8b74-f002701d12ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:15.221137 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9bc0ddff-5870-4025-8b74-f002701d12ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:15.228593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9bc0ddff-5870-4025-8b74-f002701d12ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:15.229056 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9bc0ddff-5870-4025-8b74-f002701d12ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:15.229884 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9bc0ddff-5870-4025-8b74-f002701d12ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:15.230328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9bc0ddff-5870-4025-8b74-f002701d12ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:15.325912 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9bc0ddff-5870-4025-8b74-f002701d12ba tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 14 microversion: 2.1 time: 0.109404 Dec 15 19:06:15.326863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 278/533] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:15 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:06:15.450241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:15.450857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:15.458239 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:15.458901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:15.459867 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:15.460300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:15.602458 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:15.612359 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:15.613840 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:15.615197 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-deee2433-99c6-44e4-a05f-9e9c83e1c097 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.169272 Dec 15 19:06:15.636892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 279/534] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:15 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:15.834558 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e5d559bb-0976-4be3-980e-baf6eb185812 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.477689 Dec 15 19:06:15.860890 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 256/535] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:06:14 2021] POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments => generated 194 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:16.034144 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0b3ef2a0-d60f-4ddb-be99-ae338543830c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:16.038127 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0b3ef2a0-d60f-4ddb-be99-ae338543830c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:16.041537 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b3ef2a0-d60f-4ddb-be99-ae338543830c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:16.042235 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b3ef2a0-d60f-4ddb-be99-ae338543830c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:16.043254 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b3ef2a0-d60f-4ddb-be99-ae338543830c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:16.043765 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b3ef2a0-d60f-4ddb-be99-ae338543830c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:16.277239 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0b3ef2a0-d60f-4ddb-be99-ae338543830c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:16.287617 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0b3ef2a0-d60f-4ddb-be99-ae338543830c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.257293 Dec 15 19:06:16.288747 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 280/536] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:16 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:16.327604 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-acd994a6-d58d-4894-a545-5ccd6a5ec89f req-250a2bfc-12bf-45fc-9dff-54c7bd108974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75af622f-27d3-45a3-8cd5-c58be636bf58", "name": "network-vif-plugged", "status": "completed", "tag": "ccb93599-d69e-4dee-a1b0-4b565ff2cdda"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:16.330058 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:06:16.330058 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:06:16.335698 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-30c8817b-bec6-4b56-9f31-3961324900b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:16.338901 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-acd994a6-d58d-4894-a545-5ccd6a5ec89f req-250a2bfc-12bf-45fc-9dff-54c7bd108974 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:16.339094 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-30c8817b-bec6-4b56-9f31-3961324900b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:16.339904 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-acd994a6-d58d-4894-a545-5ccd6a5ec89f req-250a2bfc-12bf-45fc-9dff-54c7bd108974 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:16.350490 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-30c8817b-bec6-4b56-9f31-3961324900b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:16.351281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-30c8817b-bec6-4b56-9f31-3961324900b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:16.352269 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-30c8817b-bec6-4b56-9f31-3961324900b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:16.352846 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-acd994a6-d58d-4894-a545-5ccd6a5ec89f req-250a2bfc-12bf-45fc-9dff-54c7bd108974 service nova] Creating event network-vif-plugged:ccb93599-d69e-4dee-a1b0-4b565ff2cdda for instance 75af622f-27d3-45a3-8cd5-c58be636bf58 on hv-cinder-81268 Dec 15 19:06:16.355707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-30c8817b-bec6-4b56-9f31-3961324900b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:16.358414 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-acd994a6-d58d-4894-a545-5ccd6a5ec89f req-250a2bfc-12bf-45fc-9dff-54c7bd108974 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034572 Dec 15 19:06:16.358954 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 257/537] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:06:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:16.455071 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-30c8817b-bec6-4b56-9f31-3961324900b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 6795 microversion: 2.1 time: 0.122607 Dec 15 19:06:16.456272 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 281/538] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:16 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 6795 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:16.645143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:16.646142 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:16.652623 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:16.653310 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:16.654266 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:16.654918 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:16.854437 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:16.865022 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:16.866674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:16.867841 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b244cc69-24b5-42e7-951a-734704ce7bda tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.227573 Dec 15 19:06:16.868411 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 258/539] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:16 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:17.308610 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-deb37886-d098-4d40-805c-847a3f089630 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:17.309380 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-deb37886-d098-4d40-805c-847a3f089630 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:17.319188 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-deb37886-d098-4d40-805c-847a3f089630 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:17.319934 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-deb37886-d098-4d40-805c-847a3f089630 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:17.320894 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-deb37886-d098-4d40-805c-847a3f089630 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:17.321498 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-deb37886-d098-4d40-805c-847a3f089630 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:17.467044 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ec559a89-988a-4e5f-b5b1-00dbf245bfdd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:17.467973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ec559a89-988a-4e5f-b5b1-00dbf245bfdd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:17.476507 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec559a89-988a-4e5f-b5b1-00dbf245bfdd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:17.492863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec559a89-988a-4e5f-b5b1-00dbf245bfdd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:17.492863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec559a89-988a-4e5f-b5b1-00dbf245bfdd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:17.492863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec559a89-988a-4e5f-b5b1-00dbf245bfdd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:17.535624 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-deb37886-d098-4d40-805c-847a3f089630 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:17.548534 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-deb37886-d098-4d40-805c-847a3f089630 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.246205 Dec 15 19:06:17.549888 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 282/540] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:17 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:17.892265 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:17.892265 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:17.899716 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:17.900300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:17.901241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:17.901818 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:18.070316 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:18.085291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:18.085291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:18.085291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5ad371bd-a7f0-426d-a4e7-a8c22eba7420 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.198811 Dec 15 19:06:18.085550 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 283/541] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:17 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:18.377568 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-8169fe5f-30a9-498e-a46c-4281d938c216 req-519342d6-c837-46ff-86b2-a885ab3815e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93490542-6e11-41c3-9901-c06a1dd65cef", "name": "network-vif-plugged", "status": "completed", "tag": "2c56f2d3-88c3-4e37-b62b-41f5e58fee33"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:18.379144 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:06:18.379144 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:06:18.388479 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-8169fe5f-30a9-498e-a46c-4281d938c216 req-519342d6-c837-46ff-86b2-a885ab3815e7 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:18.389206 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-8169fe5f-30a9-498e-a46c-4281d938c216 req-519342d6-c837-46ff-86b2-a885ab3815e7 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:18.400770 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-8169fe5f-30a9-498e-a46c-4281d938c216 req-519342d6-c837-46ff-86b2-a885ab3815e7 service nova] Creating event network-vif-plugged:2c56f2d3-88c3-4e37-b62b-41f5e58fee33 for instance 93490542-6e11-41c3-9901-c06a1dd65cef on hv-cinder-81268 Dec 15 19:06:18.408572 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-8169fe5f-30a9-498e-a46c-4281d938c216 req-519342d6-c837-46ff-86b2-a885ab3815e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035527 Dec 15 19:06:18.409471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 284/542] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:06:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:18.566895 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a9bf1c3e-af27-44f2-8755-140dbb970b3d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:18.567666 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a9bf1c3e-af27-44f2-8755-140dbb970b3d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:18.576890 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9bf1c3e-af27-44f2-8755-140dbb970b3d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:18.578383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9bf1c3e-af27-44f2-8755-140dbb970b3d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:18.578383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9bf1c3e-af27-44f2-8755-140dbb970b3d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:18.578735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9bf1c3e-af27-44f2-8755-140dbb970b3d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:18.723862 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a9bf1c3e-af27-44f2-8755-140dbb970b3d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:18.731648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a9bf1c3e-af27-44f2-8755-140dbb970b3d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.168719 Dec 15 19:06:18.741997 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 285/543] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:18 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:19.101389 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:19.102334 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:19.109382 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:19.110188 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:19.111935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:19.112595 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:19.273969 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:19.281993 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:19.283669 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:19.284947 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-242e29be-2b66-4989-8f72-21c1046fb7f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.187638 Dec 15 19:06:19.286222 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 286/544] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:19 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:19.750534 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-247954a5-1b0d-45d1-88bc-0bcb1cdcafac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:19.751988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-247954a5-1b0d-45d1-88bc-0bcb1cdcafac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:19.759113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-247954a5-1b0d-45d1-88bc-0bcb1cdcafac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:19.760050 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-247954a5-1b0d-45d1-88bc-0bcb1cdcafac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:19.761114 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-247954a5-1b0d-45d1-88bc-0bcb1cdcafac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:19.761757 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-247954a5-1b0d-45d1-88bc-0bcb1cdcafac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:19.925129 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-247954a5-1b0d-45d1-88bc-0bcb1cdcafac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:19.933061 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-247954a5-1b0d-45d1-88bc-0bcb1cdcafac tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.186470 Dec 15 19:06:19.933711 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 287/545] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:19 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:20.303343 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:20.304021 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:20.312277 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:20.312832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:20.313717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:20.314225 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:20.462081 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:20.472081 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:20.473623 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:20.474810 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-477661e6-1704-40b0-a89b-430b096f8cfa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.175371 Dec 15 19:06:20.475364 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 288/546] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:20 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:20.787837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ec559a89-988a-4e5f-b5b1-00dbf245bfdd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 19133 microversion: 2.1 time: 3.324424 Dec 15 19:06:20.788730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 259/547] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:17 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 19133 bytes in 3326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:20.950230 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5b515039-d553-457b-8c20-d8879a890c37 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:20.950861 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5b515039-d553-457b-8c20-d8879a890c37 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:20.956617 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5b515039-d553-457b-8c20-d8879a890c37 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:20.957064 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5b515039-d553-457b-8c20-d8879a890c37 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:20.957885 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5b515039-d553-457b-8c20-d8879a890c37 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:20.958343 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5b515039-d553-457b-8c20-d8879a890c37 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:21.100948 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5b515039-d553-457b-8c20-d8879a890c37 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:21.108802 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5b515039-d553-457b-8c20-d8879a890c37 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.162291 Dec 15 19:06:21.109420 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 289/548] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:20 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:21.496487 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:21.496487 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:21.501995 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:21.502435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:21.507280 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:21.510418 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:21.679975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:21.699640 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:21.699640 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:21.700895 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-62f92bd9-4ec1-4d2e-9ada-bed53a19b4d4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.210742 Dec 15 19:06:21.701624 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 260/549] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:21 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:21.799988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7fafd0ce-0b02-4c55-b020-4ccc1fa91f03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:21.801450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7fafd0ce-0b02-4c55-b020-4ccc1fa91f03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:21.809950 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7fafd0ce-0b02-4c55-b020-4ccc1fa91f03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:21.810718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7fafd0ce-0b02-4c55-b020-4ccc1fa91f03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:21.811774 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7fafd0ce-0b02-4c55-b020-4ccc1fa91f03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:21.812445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7fafd0ce-0b02-4c55-b020-4ccc1fa91f03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:21.914610 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7fafd0ce-0b02-4c55-b020-4ccc1fa91f03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 20450 microversion: 2.1 time: 0.118551 Dec 15 19:06:21.915952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 290/550] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:21 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 20450 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:22.128252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6e79bf63-2da2-453f-a08d-9ddb6e585831 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:22.131567 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6e79bf63-2da2-453f-a08d-9ddb6e585831 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:22.139931 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6e79bf63-2da2-453f-a08d-9ddb6e585831 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:22.141920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6e79bf63-2da2-453f-a08d-9ddb6e585831 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:22.142916 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6e79bf63-2da2-453f-a08d-9ddb6e585831 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:22.143521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6e79bf63-2da2-453f-a08d-9ddb6e585831 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:22.331676 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6e79bf63-2da2-453f-a08d-9ddb6e585831 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:22.342039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6e79bf63-2da2-453f-a08d-9ddb6e585831 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1318 microversion: 2.1 time: 0.217348 Dec 15 19:06:22.347100 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 261/551] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:22 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:22.720937 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:22.722650 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:22.731851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:22.733411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:22.735714 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:22.736834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:22.911182 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:22.926238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:22.927378 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8c5c79a3-16d8-4024-9565-113f11f1cd45 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:22.928569 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:22.929901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-84d02be9-4c9f-49f2-8f51-cf6a793aca1b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.213647 Dec 15 19:06:22.930323 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8c5c79a3-16d8-4024-9565-113f11f1cd45 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:22.931187 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 291/552] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:22 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:22.938326 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8c5c79a3-16d8-4024-9565-113f11f1cd45 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:22.938984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8c5c79a3-16d8-4024-9565-113f11f1cd45 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:22.940264 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8c5c79a3-16d8-4024-9565-113f11f1cd45 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:22.940874 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8c5c79a3-16d8-4024-9565-113f11f1cd45 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:23.041474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8c5c79a3-16d8-4024-9565-113f11f1cd45 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 21937 microversion: 2.1 time: 0.117704 Dec 15 19:06:23.045576 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 262/553] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:22 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 21937 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:06:23.363408 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6e3d3ec9-99fc-4c1f-9bd9-769bee9038c3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:23.364014 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6e3d3ec9-99fc-4c1f-9bd9-769bee9038c3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:23.382193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e3d3ec9-99fc-4c1f-9bd9-769bee9038c3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:23.382653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e3d3ec9-99fc-4c1f-9bd9-769bee9038c3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:23.383464 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e3d3ec9-99fc-4c1f-9bd9-769bee9038c3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:23.383900 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e3d3ec9-99fc-4c1f-9bd9-769bee9038c3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:23.539838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6e3d3ec9-99fc-4c1f-9bd9-769bee9038c3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:23.550769 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6e3d3ec9-99fc-4c1f-9bd9-769bee9038c3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1508 microversion: 2.1 time: 0.191364 Dec 15 19:06:23.551936 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 292/554] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:23 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:23.951118 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:23.951859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:23.959968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:23.963133 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:23.963133 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:23.963133 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:24.054473 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c95d3605-52ba-4205-ac05-44092de26864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:24.055965 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c95d3605-52ba-4205-ac05-44092de26864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:24.064160 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c95d3605-52ba-4205-ac05-44092de26864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:24.064624 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c95d3605-52ba-4205-ac05-44092de26864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:24.065437 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c95d3605-52ba-4205-ac05-44092de26864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:24.066051 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c95d3605-52ba-4205-ac05-44092de26864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:24.139531 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:24.153546 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:24.155161 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:24.156341 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bd8762ed-73c8-4035-b9e2-e3bf569a4886 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.210212 Dec 15 19:06:24.157903 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 263/555] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:23 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:25.174078 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:25.178792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:25.186763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:25.188199 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:25.189194 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:25.189781 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:25.385500 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:25.394290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:25.395823 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:25.396960 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-deb6b121-8a71-4feb-9e66-88fd7d2cd368 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.226675 Dec 15 19:06:25.397864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 264/556] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:25 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:26.415986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:26.416658 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:26.432925 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:26.432925 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:26.432925 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:26.432925 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:26.437812 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c95d3605-52ba-4205-ac05-44092de26864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 24433 microversion: 2.1 time: 2.387570 Dec 15 19:06:26.438750 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 293/557] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:24 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 24433 bytes in 2390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:26.568832 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:26.580817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:26.582363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:26.583500 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d1259932-022c-4b79-bf8f-f3f576e6a6f6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1734 microversion: 2.20 time: 0.171513 Dec 15 19:06:26.584051 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 265/558] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:26 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:27.441374 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fbadf063-1a5e-4d54-8737-d886b15d073c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f70c0a0-7601-4ba9-aa1a-a01f5b8c1359"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:27.442542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fbadf063-1a5e-4d54-8737-d886b15d073c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:27.449587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fc37a97a-6f09-4682-8647-9bd9c9d9022e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:27.451047 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fc37a97a-6f09-4682-8647-9bd9c9d9022e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:27.462638 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fc37a97a-6f09-4682-8647-9bd9c9d9022e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:27.463103 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fc37a97a-6f09-4682-8647-9bd9c9d9022e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:27.465818 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fbadf063-1a5e-4d54-8737-d886b15d073c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:27.466250 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fc37a97a-6f09-4682-8647-9bd9c9d9022e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:27.466879 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fc37a97a-6f09-4682-8647-9bd9c9d9022e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:27.469340 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fbadf063-1a5e-4d54-8737-d886b15d073c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:27.473453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fbadf063-1a5e-4d54-8737-d886b15d073c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:27.473453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fbadf063-1a5e-4d54-8737-d886b15d073c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:27.578597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fc37a97a-6f09-4682-8647-9bd9c9d9022e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 25479 microversion: 2.1 time: 0.132519 Dec 15 19:06:27.582530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 266/559] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:27 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 25479 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:06:27.601721 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:27.602434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:27.616523 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:27.617283 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:27.618322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:27.618912 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:27.764968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:27.775546 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:27.777064 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:27.778263 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d282eb27-43f7-4827-9e02-967e3f72ddec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1716 microversion: 2.20 time: 0.180631 Dec 15 19:06:27.780824 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 267/560] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:27 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1716 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:28.308446 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fbadf063-1a5e-4d54-8737-d886b15d073c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "POST /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870950 Dec 15 19:06:28.309278 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 294/561] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:06:27 2021] POST /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:28.370689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-571090098", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:28.424681 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] validate_networks() for None {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:06:28.590857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d0ebb2bb-7b75-4a19-874f-1bd480cc5425 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:28.591922 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d0ebb2bb-7b75-4a19-874f-1bd480cc5425 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:28.598618 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d0ebb2bb-7b75-4a19-874f-1bd480cc5425 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:28.599063 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d0ebb2bb-7b75-4a19-874f-1bd480cc5425 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:28.599836 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d0ebb2bb-7b75-4a19-874f-1bd480cc5425 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:28.600283 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d0ebb2bb-7b75-4a19-874f-1bd480cc5425 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:28.699039 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d0ebb2bb-7b75-4a19-874f-1bd480cc5425 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 26042 microversion: 2.1 time: 0.111753 Dec 15 19:06:28.704022 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 295/562] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:28 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 26042 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:06:28.709163 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:06:28.714593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:06:28.714593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:06:28.714593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:06:28.714593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:06:28.721352 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:28.721895 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:28.722908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:28.723343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:28.741434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Getting quotas for project 64813529e60447d4a41fcf486adf44dd. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:06:28.746475 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Getting quotas for user 02e26d3fb9224a6a8b093b1ff7852430 and project 64813529e60447d4a41fcf486adf44dd. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:06:28.759844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:06:28.762494 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:06:28.800958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:28.801813 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:28.809215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:28.809796 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:28.811135 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:28.811565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:28.885541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bca6b455-99a6-4ad4-8c4e-fbd37809c7b9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518522 Dec 15 19:06:28.886458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 268/563] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:06:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:06:28.901689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8d13fb4c-67bd-48b5-89f6-98ac574e99b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:28.901689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8d13fb4c-67bd-48b5-89f6-98ac574e99b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:28.903981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8d13fb4c-67bd-48b5-89f6-98ac574e99b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:28.904434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8d13fb4c-67bd-48b5-89f6-98ac574e99b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:28.905347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8d13fb4c-67bd-48b5-89f6-98ac574e99b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:28.905882 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8d13fb4c-67bd-48b5-89f6-98ac574e99b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:28.931646 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-8d13fb4c-67bd-48b5-89f6-98ac574e99b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lazy-loading 'flavor' on Instance uuid 93f130e2-e041-400a-934f-9c837ba505ef {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:06:28.955702 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:28.964309 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:28.966310 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:28.967654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-dfb6c1b4-4210-42d0-a1d2-c9df6a3cfc5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1716 microversion: 2.20 time: 0.172279 Dec 15 19:06:28.968357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 296/564] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:28 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1716 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:28.983568 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-52d0f323-652f-4e61-b533-e1b49b3b1f64 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:28.985256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-52d0f323-652f-4e61-b533-e1b49b3b1f64 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:29.036297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-52d0f323-652f-4e61-b533-e1b49b3b1f64 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:29.042802 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-52d0f323-652f-4e61-b533-e1b49b3b1f64 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1214 microversion: 2.1 time: 0.063232 Dec 15 19:06:29.043350 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 297/565] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:28 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:29.241142 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8d13fb4c-67bd-48b5-89f6-98ac574e99b6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/action" status: 200 len: 32 microversion: 2.1 time: 0.347218 Dec 15 19:06:29.241142 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 269/566] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:28 2021] POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/action => generated 32 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:06:29.251466 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c848a0a0-9c01-4143-8f13-84f3c39c7616 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:29.252394 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c848a0a0-9c01-4143-8f13-84f3c39c7616 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:29.259950 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c848a0a0-9c01-4143-8f13-84f3c39c7616 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:29.260539 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c848a0a0-9c01-4143-8f13-84f3c39c7616 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:29.261459 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c848a0a0-9c01-4143-8f13-84f3c39c7616 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:29.261983 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c848a0a0-9c01-4143-8f13-84f3c39c7616 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:29.398460 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c848a0a0-9c01-4143-8f13-84f3c39c7616 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:29.406881 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c848a0a0-9c01-4143-8f13-84f3c39c7616 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.159854 Dec 15 19:06:29.407650 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 298/567] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:29 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:29.711885 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-89c2e69a-65da-4203-b4e2-3a2c13593407 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:29.712993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-89c2e69a-65da-4203-b4e2-3a2c13593407 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:29.719671 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89c2e69a-65da-4203-b4e2-3a2c13593407 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:29.720126 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89c2e69a-65da-4203-b4e2-3a2c13593407 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:29.720905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89c2e69a-65da-4203-b4e2-3a2c13593407 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:29.721369 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89c2e69a-65da-4203-b4e2-3a2c13593407 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:29.986807 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:29.991385 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:29.993994 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:29.994435 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:29.995207 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:29.995652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:30.124118 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:30.132094 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:30.133633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:30.134772 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b897c93b-ff93-4045-aad1-6c3e6ee8d176 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1716 microversion: 2.20 time: 0.152340 Dec 15 19:06:30.135326 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 299/568] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:29 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:30.139429 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-acd26201-541e-460a-b040-4652d23b70f6 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:30.140020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-acd26201-541e-460a-b040-4652d23b70f6 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:30.145940 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-acd26201-541e-460a-b040-4652d23b70f6 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:30.146387 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-acd26201-541e-460a-b040-4652d23b70f6 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:30.147166 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-acd26201-541e-460a-b040-4652d23b70f6 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:30.147601 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-acd26201-541e-460a-b040-4652d23b70f6 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:30.202404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-acd26201-541e-460a-b040-4652d23b70f6 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:30.209930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-acd26201-541e-460a-b040-4652d23b70f6 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1218 microversion: 2.1 time: 0.073681 Dec 15 19:06:30.210493 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 300/569] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:30 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:30.423767 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0b27948f-f86f-4f27-a529-a5d400e08ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:30.424381 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0b27948f-f86f-4f27-a529-a5d400e08ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:30.430508 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b27948f-f86f-4f27-a529-a5d400e08ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:30.430962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b27948f-f86f-4f27-a529-a5d400e08ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:30.431744 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b27948f-f86f-4f27-a529-a5d400e08ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:30.432181 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b27948f-f86f-4f27-a529-a5d400e08ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:30.561525 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0b27948f-f86f-4f27-a529-a5d400e08ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:30.569834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0b27948f-f86f-4f27-a529-a5d400e08ab5 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.149803 Dec 15 19:06:30.570404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 301/570] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:30 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:31.153541 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:31.154161 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:31.160496 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:31.160941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:31.161755 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:31.162211 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:31.295112 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:31.303300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:31.304798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:31.305935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-700d2d6c-1aaa-4252-9052-baadb129508a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1716 microversion: 2.20 time: 0.156161 Dec 15 19:06:31.306488 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 302/571] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:31 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:31.310663 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2dc17147-8346-4767-84fb-393b5803b168 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:31.311250 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2dc17147-8346-4767-84fb-393b5803b168 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:31.316443 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2dc17147-8346-4767-84fb-393b5803b168 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:31.316884 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2dc17147-8346-4767-84fb-393b5803b168 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:31.317680 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2dc17147-8346-4767-84fb-393b5803b168 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:31.318115 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2dc17147-8346-4767-84fb-393b5803b168 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:31.374324 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-2dc17147-8346-4767-84fb-393b5803b168 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:31.381878 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2dc17147-8346-4767-84fb-393b5803b168 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1218 microversion: 2.1 time: 0.074480 Dec 15 19:06:31.382433 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 303/572] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:31 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:31.587084 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1a081f0a-effa-43a9-a426-66ab197b41c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:31.587720 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1a081f0a-effa-43a9-a426-66ab197b41c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:31.594641 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1a081f0a-effa-43a9-a426-66ab197b41c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:31.595090 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1a081f0a-effa-43a9-a426-66ab197b41c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:31.595876 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1a081f0a-effa-43a9-a426-66ab197b41c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:31.596314 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1a081f0a-effa-43a9-a426-66ab197b41c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:31.726443 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1a081f0a-effa-43a9-a426-66ab197b41c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:31.734342 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1a081f0a-effa-43a9-a426-66ab197b41c1 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.150814 Dec 15 19:06:31.734901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 304/573] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:31 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:32.219685 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-89c2e69a-65da-4203-b4e2-3a2c13593407 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 27647 microversion: 2.1 time: 2.511759 Dec 15 19:06:32.220350 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 270/574] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:29 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 27647 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:32.245193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-bd25a67e-c23c-4b64-a61b-af21a6ad2c31 req-af92db3d-f0e7-4c2d-8d14-5bef42a130b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93490542-6e11-41c3-9901-c06a1dd65cef", "name": "network-vif-unplugged", "status": "completed", "tag": "2c56f2d3-88c3-4e37-b62b-41f5e58fee33"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:32.246953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:06:32.246953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:06:32.255658 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-bd25a67e-c23c-4b64-a61b-af21a6ad2c31 req-af92db3d-f0e7-4c2d-8d14-5bef42a130b3 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:32.256183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-bd25a67e-c23c-4b64-a61b-af21a6ad2c31 req-af92db3d-f0e7-4c2d-8d14-5bef42a130b3 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:32.267458 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-bd25a67e-c23c-4b64-a61b-af21a6ad2c31 req-af92db3d-f0e7-4c2d-8d14-5bef42a130b3 service nova] Creating event network-vif-unplugged:2c56f2d3-88c3-4e37-b62b-41f5e58fee33 for instance 93490542-6e11-41c3-9901-c06a1dd65cef on hv-cinder-81268 Dec 15 19:06:32.272313 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-bd25a67e-c23c-4b64-a61b-af21a6ad2c31 req-af92db3d-f0e7-4c2d-8d14-5bef42a130b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030818 Dec 15 19:06:32.272964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 305/575] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:06:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:06:32.324112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:32.324798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:32.333392 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:32.333772 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:32.334632 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:32.335226 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:32.400126 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1d9b2143-2f07-402c-8141-0b22e1ced5e1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:32.401159 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1d9b2143-2f07-402c-8141-0b22e1ced5e1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:32.407836 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1d9b2143-2f07-402c-8141-0b22e1ced5e1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:32.408293 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1d9b2143-2f07-402c-8141-0b22e1ced5e1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:32.409105 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1d9b2143-2f07-402c-8141-0b22e1ced5e1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:32.409557 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1d9b2143-2f07-402c-8141-0b22e1ced5e1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:32.482544 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:32.491147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:32.492593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1d9b2143-2f07-402c-8141-0b22e1ced5e1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:32.493173 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:32.494422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-683437ca-09c6-4c17-a9c3-197471a3c43e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1716 microversion: 2.20 time: 0.174296 Dec 15 19:06:32.505849 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 271/576] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:32 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1716 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:32.507207 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1d9b2143-2f07-402c-8141-0b22e1ced5e1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1218 microversion: 2.1 time: 0.111974 Dec 15 19:06:32.507946 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 306/577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:32 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:32.751233 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3d1dc4e9-6695-49e9-ae98-8d1b392c3169 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:32.751909 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3d1dc4e9-6695-49e9-ae98-8d1b392c3169 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:32.758674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3d1dc4e9-6695-49e9-ae98-8d1b392c3169 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:32.759118 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3d1dc4e9-6695-49e9-ae98-8d1b392c3169 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:32.759892 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3d1dc4e9-6695-49e9-ae98-8d1b392c3169 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:32.760316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3d1dc4e9-6695-49e9-ae98-8d1b392c3169 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:32.896265 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3d1dc4e9-6695-49e9-ae98-8d1b392c3169 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:32.904084 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3d1dc4e9-6695-49e9-ae98-8d1b392c3169 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.156634 Dec 15 19:06:32.904655 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 272/578] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:32 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:33.231384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-aa0f7285-52f2-4dec-88bf-4b01a8220252 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:33.232299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-aa0f7285-52f2-4dec-88bf-4b01a8220252 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:33.238646 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-aa0f7285-52f2-4dec-88bf-4b01a8220252 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.239163 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-aa0f7285-52f2-4dec-88bf-4b01a8220252 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:33.239972 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-aa0f7285-52f2-4dec-88bf-4b01a8220252 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.240411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-aa0f7285-52f2-4dec-88bf-4b01a8220252 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:33.359413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-aa0f7285-52f2-4dec-88bf-4b01a8220252 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 27833 microversion: 2.1 time: 0.131507 Dec 15 19:06:33.363443 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 307/579] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:33 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 27833 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:33.513347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:33.514513 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:33.523930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-16105a09-e5e6-4c07-9fde-1a9d4c42a54f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:33.528049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-16105a09-e5e6-4c07-9fde-1a9d4c42a54f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:33.535297 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.536759 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-16105a09-e5e6-4c07-9fde-1a9d4c42a54f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.537440 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-16105a09-e5e6-4c07-9fde-1a9d4c42a54f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:33.538454 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-16105a09-e5e6-4c07-9fde-1a9d4c42a54f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.539058 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:33.540413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-16105a09-e5e6-4c07-9fde-1a9d4c42a54f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:33.540648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.541559 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:33.650169 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-16105a09-e5e6-4c07-9fde-1a9d4c42a54f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:33.664886 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-16105a09-e5e6-4c07-9fde-1a9d4c42a54f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1274 microversion: 2.1 time: 0.144760 Dec 15 19:06:33.665634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 308/580] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:33 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:33.728391 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:33.738510 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:33.740047 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:33.741509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-53751ea8-f7f8-4fde-8e4b-8d62e1267514 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1719 microversion: 2.20 time: 0.231730 Dec 15 19:06:33.742335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 273/581] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:33 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1719 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:33.761668 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1b333f92-96d7-4ad0-9e43-daf026abc7ba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8237816-6020-4013-8383-a1f925ff90a2"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:33.762667 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1b333f92-96d7-4ad0-9e43-daf026abc7ba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:33.769533 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1b333f92-96d7-4ad0-9e43-daf026abc7ba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.769979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1b333f92-96d7-4ad0-9e43-daf026abc7ba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:33.770759 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1b333f92-96d7-4ad0-9e43-daf026abc7ba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.771357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1b333f92-96d7-4ad0-9e43-daf026abc7ba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:33.920500 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-087ab6c4-cb8b-421c-8207-66a12b2b991e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:33.921268 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-087ab6c4-cb8b-421c-8207-66a12b2b991e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:33.928179 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-087ab6c4-cb8b-421c-8207-66a12b2b991e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.928631 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-087ab6c4-cb8b-421c-8207-66a12b2b991e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:33.929464 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-087ab6c4-cb8b-421c-8207-66a12b2b991e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:33.929905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-087ab6c4-cb8b-421c-8207-66a12b2b991e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:34.064157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-087ab6c4-cb8b-421c-8207-66a12b2b991e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:34.078060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-087ab6c4-cb8b-421c-8207-66a12b2b991e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.161175 Dec 15 19:06:34.078646 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 274/582] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:33 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:34.371307 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-460b61bd-d66c-4c85-94fd-ae7ccaccb440 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:34.372279 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-460b61bd-d66c-4c85-94fd-ae7ccaccb440 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:34.378901 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-460b61bd-d66c-4c85-94fd-ae7ccaccb440 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:34.379384 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-460b61bd-d66c-4c85-94fd-ae7ccaccb440 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:34.380182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-460b61bd-d66c-4c85-94fd-ae7ccaccb440 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:34.380666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-460b61bd-d66c-4c85-94fd-ae7ccaccb440 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:34.509288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-460b61bd-d66c-4c85-94fd-ae7ccaccb440 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 28206 microversion: 2.1 time: 0.141509 Dec 15 19:06:34.509955 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 275/583] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:34 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 28206 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:06:34.693623 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1a8fee2d-be92-4d6d-aef0-ec8ce3f7257e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:34.694262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1a8fee2d-be92-4d6d-aef0-ec8ce3f7257e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:34.701100 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1a8fee2d-be92-4d6d-aef0-ec8ce3f7257e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:34.701557 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1a8fee2d-be92-4d6d-aef0-ec8ce3f7257e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:34.702337 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1a8fee2d-be92-4d6d-aef0-ec8ce3f7257e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:34.703262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1a8fee2d-be92-4d6d-aef0-ec8ce3f7257e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:34.774442 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1a8fee2d-be92-4d6d-aef0-ec8ce3f7257e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:34.784028 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1a8fee2d-be92-4d6d-aef0-ec8ce3f7257e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1272 microversion: 2.1 time: 0.094488 Dec 15 19:06:34.784707 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 276/584] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:34 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:34.862537 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1b333f92-96d7-4ad0-9e43-daf026abc7ba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.104738 Dec 15 19:06:34.864071 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 309/585] 10.222.0.49 () {62 vars in 1363 bytes} [Wed Dec 15 19:06:33 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments => generated 188 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:34.991474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a46ed4bd-8fd7-4e20-8c1b-f545db4bcf4c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:34.991764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a46ed4bd-8fd7-4e20-8c1b-f545db4bcf4c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:34.998137 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a46ed4bd-8fd7-4e20-8c1b-f545db4bcf4c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:34.998582 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a46ed4bd-8fd7-4e20-8c1b-f545db4bcf4c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:34.999367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a46ed4bd-8fd7-4e20-8c1b-f545db4bcf4c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.000297 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a46ed4bd-8fd7-4e20-8c1b-f545db4bcf4c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.095413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1096250a-a2cc-43e9-b4b9-e8b4d50f4af3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:35.096303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1096250a-a2cc-43e9-b4b9-e8b4d50f4af3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:35.102283 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1096250a-a2cc-43e9-b4b9-e8b4d50f4af3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.102735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1096250a-a2cc-43e9-b4b9-e8b4d50f4af3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.103529 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1096250a-a2cc-43e9-b4b9-e8b4d50f4af3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.103969 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1096250a-a2cc-43e9-b4b9-e8b4d50f4af3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.245043 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a46ed4bd-8fd7-4e20-8c1b-f545db4bcf4c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action" status: 202 len: 0 microversion: 2.20 time: 0.257663 Dec 15 19:06:35.245691 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 277/586] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:06:34 2021] POST /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:06:35.263401 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:35.263401 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:35.270873 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.271403 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.276799 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.277313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.360098 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1096250a-a2cc-43e9-b4b9-e8b4d50f4af3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:35.372165 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1096250a-a2cc-43e9-b4b9-e8b4d50f4af3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.279904 Dec 15 19:06:35.378056 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 310/587] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:35 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:35.433642 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:35.443094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:35.444947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:35.450589 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-50ce017d-f0b7-4f90-9d2a-012b947c20bf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1745 microversion: 2.20 time: 0.192461 Dec 15 19:06:35.450589 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 278/588] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:35 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:35.521191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c2875603-1b8f-4700-bbd1-6b6ddc4037a5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:35.522193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c2875603-1b8f-4700-bbd1-6b6ddc4037a5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:35.528345 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2875603-1b8f-4700-bbd1-6b6ddc4037a5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.532857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2875603-1b8f-4700-bbd1-6b6ddc4037a5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.532857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2875603-1b8f-4700-bbd1-6b6ddc4037a5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.532857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2875603-1b8f-4700-bbd1-6b6ddc4037a5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.635841 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c2875603-1b8f-4700-bbd1-6b6ddc4037a5 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 28250 microversion: 2.1 time: 0.118206 Dec 15 19:06:35.637268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 311/589] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:35 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 28250 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:35.802426 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f9a09450-4f1e-494c-81a0-7c880c2c1218 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:35.803069 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f9a09450-4f1e-494c-81a0-7c880c2c1218 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:35.809833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f9a09450-4f1e-494c-81a0-7c880c2c1218 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.810285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f9a09450-4f1e-494c-81a0-7c880c2c1218 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.814332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f9a09450-4f1e-494c-81a0-7c880c2c1218 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.814332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f9a09450-4f1e-494c-81a0-7c880c2c1218 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.896420 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-0cd4be22-8c81-4d66-84a5-7691edd274f6 req-0e688d6b-1b1e-429d-8ee2-e23733fb8fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848dbdaf-18c0-4beb-a74b-5b6d09d5911f", "tag": "6ebe1443-a187-419b-b3fd-548c8b30dbb0"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:35.899301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:06:35.899301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:06:35.918208 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-0cd4be22-8c81-4d66-84a5-7691edd274f6 req-0e688d6b-1b1e-429d-8ee2-e23733fb8fd1 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:35.919225 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-0cd4be22-8c81-4d66-84a5-7691edd274f6 req-0e688d6b-1b1e-429d-8ee2-e23733fb8fd1 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:35.940403 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-0cd4be22-8c81-4d66-84a5-7691edd274f6 req-0e688d6b-1b1e-429d-8ee2-e23733fb8fd1 service nova] Creating event network-changed:6ebe1443-a187-419b-b3fd-548c8b30dbb0 for instance 848dbdaf-18c0-4beb-a74b-5b6d09d5911f on hv-cinder-81268 Dec 15 19:06:35.946238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-0cd4be22-8c81-4d66-84a5-7691edd274f6 req-0e688d6b-1b1e-429d-8ee2-e23733fb8fd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054985 Dec 15 19:06:35.947529 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 312/590] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:06:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:36.061445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f9a09450-4f1e-494c-81a0-7c880c2c1218 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:36.070819 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f9a09450-4f1e-494c-81a0-7c880c2c1218 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.272583 Dec 15 19:06:36.071732 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 279/591] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:35 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:36.393309 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-186d5630-e9e7-4049-bbbc-548e9d7a694b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:36.394007 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-186d5630-e9e7-4049-bbbc-548e9d7a694b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:36.400093 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-186d5630-e9e7-4049-bbbc-548e9d7a694b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:36.400549 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-186d5630-e9e7-4049-bbbc-548e9d7a694b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:36.401355 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-186d5630-e9e7-4049-bbbc-548e9d7a694b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:36.401784 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-186d5630-e9e7-4049-bbbc-548e9d7a694b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:36.463993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:36.464599 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:36.471721 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:36.472701 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:36.473780 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:36.474283 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:36.612681 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:36.615019 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-186d5630-e9e7-4049-bbbc-548e9d7a694b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:36.623024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:36.624010 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-186d5630-e9e7-4049-bbbc-548e9d7a694b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.236955 Dec 15 19:06:36.625195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:36.625369 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 313/592] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:36 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:36.626845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5acb3f21-ef57-4f5c-a2aa-b91b9dccd0c0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1745 microversion: 2.20 time: 0.166874 Dec 15 19:06:36.627479 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 280/593] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:36 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:36.647595 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bc549a52-a925-4490-8fb0-c763ed2cc9bb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:36.648497 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bc549a52-a925-4490-8fb0-c763ed2cc9bb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:36.655501 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bc549a52-a925-4490-8fb0-c763ed2cc9bb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:36.656753 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bc549a52-a925-4490-8fb0-c763ed2cc9bb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:36.656962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bc549a52-a925-4490-8fb0-c763ed2cc9bb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:36.657576 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bc549a52-a925-4490-8fb0-c763ed2cc9bb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:36.747750 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bc549a52-a925-4490-8fb0-c763ed2cc9bb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 28250 microversion: 2.1 time: 0.103601 Dec 15 19:06:36.748673 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 314/594] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:36 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 28250 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:06:37.087335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-91bdf961-f8d4-4096-a544-0b507cafe7e9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:37.088026 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-91bdf961-f8d4-4096-a544-0b507cafe7e9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:37.094348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-91bdf961-f8d4-4096-a544-0b507cafe7e9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.094798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-91bdf961-f8d4-4096-a544-0b507cafe7e9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.095594 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-91bdf961-f8d4-4096-a544-0b507cafe7e9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.096012 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-91bdf961-f8d4-4096-a544-0b507cafe7e9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.152755 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-688e6514-6004-469c-a995-81341394bea8 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:37.153367 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-688e6514-6004-469c-a995-81341394bea8 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:37.160951 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-688e6514-6004-469c-a995-81341394bea8 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.161495 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-688e6514-6004-469c-a995-81341394bea8 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.162286 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-688e6514-6004-469c-a995-81341394bea8 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.162726 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-688e6514-6004-469c-a995-81341394bea8 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.228067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-91bdf961-f8d4-4096-a544-0b507cafe7e9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:37.236239 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-91bdf961-f8d4-4096-a544-0b507cafe7e9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.152576 Dec 15 19:06:37.236800 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 281/595] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:37 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:37.247305 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-688e6514-6004-469c-a995-81341394bea8 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lazy-loading 'services' on Instance uuid 26e09c87-53f0-4d48-9eba-d5adae8227e3 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:06:37.470702 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-688e6514-6004-469c-a995-81341394bea8 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "DELETE /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3/os-volume_attachments/69c3e4e7-1790-4bea-9ab8-a1909ea08d2a" status: 202 len: 0 microversion: 2.1 time: 0.321863 Dec 15 19:06:37.471292 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 315/596] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:06:37 2021] DELETE /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3/os-volume_attachments/69c3e4e7-1790-4bea-9ab8-a1909ea08d2a => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:06:37.641882 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3e7ba39b-eadf-4350-92e0-4b81dd702d94 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:37.643441 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3e7ba39b-eadf-4350-92e0-4b81dd702d94 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:37.646432 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:37.647155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:37.649724 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e7ba39b-eadf-4350-92e0-4b81dd702d94 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.650189 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e7ba39b-eadf-4350-92e0-4b81dd702d94 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.650977 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e7ba39b-eadf-4350-92e0-4b81dd702d94 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.651472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e7ba39b-eadf-4350-92e0-4b81dd702d94 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.653257 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.653707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.654494 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.654923 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.785447 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3e7ba39b-eadf-4350-92e0-4b81dd702d94 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:37.789675 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:37.793481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3e7ba39b-eadf-4350-92e0-4b81dd702d94 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.155354 Dec 15 19:06:37.794059 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 282/597] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:37 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:37.798253 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:37.800140 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:37.801411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f9806532-126d-432f-906c-cce63c179086 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1747 microversion: 2.20 time: 0.159512 Dec 15 19:06:37.801957 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 316/598] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:37 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:37.803906 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e4b28fb5-624f-4da4-beba-d8461cab3512 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:37.806770 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e4b28fb5-624f-4da4-beba-d8461cab3512 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:37.811138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e4b28fb5-624f-4da4-beba-d8461cab3512 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.811593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e4b28fb5-624f-4da4-beba-d8461cab3512 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.812374 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e4b28fb5-624f-4da4-beba-d8461cab3512 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:37.812813 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e4b28fb5-624f-4da4-beba-d8461cab3512 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:37.903311 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e4b28fb5-624f-4da4-beba-d8461cab3512 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 28250 microversion: 2.1 time: 0.103126 Dec 15 19:06:37.903960 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 283/599] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:37 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 28250 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:38.255241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-545bed0d-cdea-4ae4-8530-831857b0a301 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:38.255898 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-545bed0d-cdea-4ae4-8530-831857b0a301 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:38.262419 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-545bed0d-cdea-4ae4-8530-831857b0a301 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:38.262860 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-545bed0d-cdea-4ae4-8530-831857b0a301 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:38.263668 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-545bed0d-cdea-4ae4-8530-831857b0a301 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:38.264097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-545bed0d-cdea-4ae4-8530-831857b0a301 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:38.389568 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-545bed0d-cdea-4ae4-8530-831857b0a301 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:38.396669 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-545bed0d-cdea-4ae4-8530-831857b0a301 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.146134 Dec 15 19:06:38.397257 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 317/600] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:38 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:38.811285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-60c696fa-ba2d-420a-b7df-7f2afbec1b9d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:38.811905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-60c696fa-ba2d-420a-b7df-7f2afbec1b9d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:38.818751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-60c696fa-ba2d-420a-b7df-7f2afbec1b9d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:38.819229 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-60c696fa-ba2d-420a-b7df-7f2afbec1b9d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:38.820002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-60c696fa-ba2d-420a-b7df-7f2afbec1b9d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:38.820436 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-60c696fa-ba2d-420a-b7df-7f2afbec1b9d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:38.825212 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:38.825822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:38.831544 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:38.831995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:38.832781 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:38.833256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:38.965546 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-60c696fa-ba2d-420a-b7df-7f2afbec1b9d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:38.965712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:38.974150 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-60c696fa-ba2d-420a-b7df-7f2afbec1b9d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.166920 Dec 15 19:06:38.974626 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:38.974742 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 284/601] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:38 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:38.979001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-43f76515-6540-46ce-86b4-8d610b56cbb3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:38.979685 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:38.979915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-43f76515-6540-46ce-86b4-8d610b56cbb3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:38.981138 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-04d13aea-0deb-401c-8192-2757c65d3a6d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1747 microversion: 2.20 time: 0.159513 Dec 15 19:06:38.981814 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 318/602] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:38 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:38.985676 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-43f76515-6540-46ce-86b4-8d610b56cbb3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:38.986126 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-43f76515-6540-46ce-86b4-8d610b56cbb3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:38.986907 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-43f76515-6540-46ce-86b4-8d610b56cbb3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:38.987344 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-43f76515-6540-46ce-86b4-8d610b56cbb3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:39.073280 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-43f76515-6540-46ce-86b4-8d610b56cbb3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 28250 microversion: 2.1 time: 0.097323 Dec 15 19:06:39.073947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 285/603] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:38 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 28250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:39.224033 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-459480221", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-782438899", "security_groups": [{"name": "tempest-secgroup-smoke-39792596"}], "block_device_mapping_v2": [{"uuid": "01dcb8db-5185-4488-a524-e35ecda41417", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f1ee251-b588-424c-abec-a3e47c426719"}]}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:39.351058 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.network.neutron [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] validate_networks() for [('8f1ee251-b588-424c-abec-a3e47c426719', None, None, None, None, None)] {{(pid=116515) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:06:39.412978 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b71cfe33-8a4e-4c1b-98bc-7e1b0513b535 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:39.413841 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b71cfe33-8a4e-4c1b-98bc-7e1b0513b535 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:39.420736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b71cfe33-8a4e-4c1b-98bc-7e1b0513b535 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:39.421214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b71cfe33-8a4e-4c1b-98bc-7e1b0513b535 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:39.422004 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b71cfe33-8a4e-4c1b-98bc-7e1b0513b535 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:39.422439 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b71cfe33-8a4e-4c1b-98bc-7e1b0513b535 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:39.562197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b71cfe33-8a4e-4c1b-98bc-7e1b0513b535 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:39.570103 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b71cfe33-8a4e-4c1b-98bc-7e1b0513b535 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.161191 Dec 15 19:06:39.570683 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 286/604] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:39 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:39.724636 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Flavor limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:06:39.725056 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Image limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:06:39.725568 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Flavor pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:06:39.725973 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Image pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:06:39.726381 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:06:39.734942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:39.735380 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:39.736682 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:39.737138 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:39.753651 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:06:39.757503 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for user b7c21b8f3da14074949d2f6ba58b7204 and project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:06:39.815755 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Going to run 1 instances... {{(pid=116515) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:06:39.818102 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01dcb8db-5185-4488-a524-e35ecda41417',volume_size=None,volume_type=None)] {{(pid=116515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:06:39.991885 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1632870e-ffeb-4927-9c89-67fe9b64091b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:39.992630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1632870e-ffeb-4927-9c89-67fe9b64091b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:39.999178 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1632870e-ffeb-4927-9c89-67fe9b64091b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:39.999617 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1632870e-ffeb-4927-9c89-67fe9b64091b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.000626 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1632870e-ffeb-4927-9c89-67fe9b64091b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.001056 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1632870e-ffeb-4927-9c89-67fe9b64091b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.133661 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1632870e-ffeb-4927-9c89-67fe9b64091b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:40.142074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1632870e-ffeb-4927-9c89-67fe9b64091b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.153776 Dec 15 19:06:40.158569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 287/605] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:39 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:40.163608 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:40.164041 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:40.169968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.170659 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.171772 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.172369 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.230805 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e49c70b9-e1a9-474f-b8b7-718581147d10 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.011090 Dec 15 19:06:40.237054 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 319/606] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:06:39 2021] POST /compute/v2.1/servers => generated 404 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:06:40.237054 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a06d8b2b-3cc2-43b5-a425-10064aa4ccaa tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:40.256503 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a06d8b2b-3cc2-43b5-a425-10064aa4ccaa tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:40.271735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a06d8b2b-3cc2-43b5-a425-10064aa4ccaa tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.272527 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a06d8b2b-3cc2-43b5-a425-10064aa4ccaa tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.273844 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a06d8b2b-3cc2-43b5-a425-10064aa4ccaa tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.275496 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a06d8b2b-3cc2-43b5-a425-10064aa4ccaa tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.385538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:40.396478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:40.400316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:40.401532 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-69fcc0ff-71bf-4283-8764-af007b1fb9d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1747 microversion: 2.20 time: 0.241807 Dec 15 19:06:40.402114 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 288/607] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:40 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1747 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:40.411156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-52598704-8d55-4dbc-a190-dd92ce3fc961 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:40.411680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-52598704-8d55-4dbc-a190-dd92ce3fc961 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:40.448159 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a06d8b2b-3cc2-43b5-a425-10064aa4ccaa tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 28539 microversion: 2.1 time: 0.214950 Dec 15 19:06:40.449555 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 320/608] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:40 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 28539 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:40.456442 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-87f64f42-40f8-4294-ba32-87a878f40f24 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:40.457117 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-87f64f42-40f8-4294-ba32-87a878f40f24 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:40.463349 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-52598704-8d55-4dbc-a190-dd92ce3fc961 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:40.463998 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87f64f42-40f8-4294-ba32-87a878f40f24 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.464496 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87f64f42-40f8-4294-ba32-87a878f40f24 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.465328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87f64f42-40f8-4294-ba32-87a878f40f24 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.465760 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-87f64f42-40f8-4294-ba32-87a878f40f24 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.473260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-52598704-8d55-4dbc-a190-dd92ce3fc961 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1093 microversion: 2.1 time: 0.066963 Dec 15 19:06:40.473260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 289/609] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:40 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:40.546455 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-87f64f42-40f8-4294-ba32-87a878f40f24 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lazy-loading 'services' on Instance uuid 75af622f-27d3-45a3-8cd5-c58be636bf58 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:06:40.587033 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-12af6cb7-2b61-4998-839b-3560d4095a8f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:40.587666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-12af6cb7-2b61-4998-839b-3560d4095a8f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:40.593999 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-12af6cb7-2b61-4998-839b-3560d4095a8f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.594444 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-12af6cb7-2b61-4998-839b-3560d4095a8f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.595880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-12af6cb7-2b61-4998-839b-3560d4095a8f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.596301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-12af6cb7-2b61-4998-839b-3560d4095a8f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.729036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-12af6cb7-2b61-4998-839b-3560d4095a8f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:40.737147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-12af6cb7-2b61-4998-839b-3560d4095a8f tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.153730 Dec 15 19:06:40.746696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 290/610] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:40 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:40.788165 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-87f64f42-40f8-4294-ba32-87a878f40f24 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments/9f70c0a0-7601-4ba9-aa1a-a01f5b8c1359" status: 202 len: 0 microversion: 2.1 time: 0.336472 Dec 15 19:06:40.788808 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 321/611] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:06:40 2021] DELETE /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments/9f70c0a0-7601-4ba9-aa1a-a01f5b8c1359 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:06:40.796891 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9252785e-3e79-450a-b153-151f7d0e42dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:40.803733 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9252785e-3e79-450a-b153-151f7d0e42dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:40.810059 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9252785e-3e79-450a-b153-151f7d0e42dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.810562 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9252785e-3e79-450a-b153-151f7d0e42dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.811357 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9252785e-3e79-450a-b153-151f7d0e42dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:40.811791 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9252785e-3e79-450a-b153-151f7d0e42dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:40.841764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9252785e-3e79-450a-b153-151f7d0e42dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048523 Dec 15 19:06:40.842323 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 291/612] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:06:40 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:41.166875 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-309877d9-a9bb-4578-9d0e-fccad350fb91 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:41.167605 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-309877d9-a9bb-4578-9d0e-fccad350fb91 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:41.174549 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-309877d9-a9bb-4578-9d0e-fccad350fb91 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.175238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-309877d9-a9bb-4578-9d0e-fccad350fb91 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.176022 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-309877d9-a9bb-4578-9d0e-fccad350fb91 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.176617 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-309877d9-a9bb-4578-9d0e-fccad350fb91 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.334418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-309877d9-a9bb-4578-9d0e-fccad350fb91 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:41.342278 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-309877d9-a9bb-4578-9d0e-fccad350fb91 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.179933 Dec 15 19:06:41.342851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 322/613] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:41 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:41.420101 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:41.420643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:41.427073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.427522 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.428309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.428747 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.460378 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d7ab8898-8d05-4245-a474-f15a309e97c2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:41.461421 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d7ab8898-8d05-4245-a474-f15a309e97c2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:41.467290 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d7ab8898-8d05-4245-a474-f15a309e97c2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.467812 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d7ab8898-8d05-4245-a474-f15a309e97c2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.468753 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d7ab8898-8d05-4245-a474-f15a309e97c2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.469145 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d7ab8898-8d05-4245-a474-f15a309e97c2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.567538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:41.579587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:41.582394 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:41.583735 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-425b3154-5e14-42b8-885c-97d5906726fa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1747 microversion: 2.20 time: 0.167472 Dec 15 19:06:41.584290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 292/614] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:41 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1747 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:41.588678 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fe58e5c4-598b-49e9-99f0-2b0753c430e6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:41.589313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fe58e5c4-598b-49e9-99f0-2b0753c430e6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:41.598094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fe58e5c4-598b-49e9-99f0-2b0753c430e6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.598094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fe58e5c4-598b-49e9-99f0-2b0753c430e6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.598409 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fe58e5c4-598b-49e9-99f0-2b0753c430e6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.598821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fe58e5c4-598b-49e9-99f0-2b0753c430e6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.645339 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d7ab8898-8d05-4245-a474-f15a309e97c2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 28539 microversion: 2.1 time: 0.188453 Dec 15 19:06:41.646025 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 323/615] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:41 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 28539 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:06:41.660917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fe58e5c4-598b-49e9-99f0-2b0753c430e6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:41.668364 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fe58e5c4-598b-49e9-99f0-2b0753c430e6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1143 microversion: 2.1 time: 0.083108 Dec 15 19:06:41.668930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 293/616] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:41 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:41.754408 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0db85ef0-e156-4caa-9f6e-099e4f033f4a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:41.755108 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0db85ef0-e156-4caa-9f6e-099e4f033f4a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:41.761931 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0db85ef0-e156-4caa-9f6e-099e4f033f4a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.762384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0db85ef0-e156-4caa-9f6e-099e4f033f4a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.763188 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0db85ef0-e156-4caa-9f6e-099e4f033f4a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.763610 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0db85ef0-e156-4caa-9f6e-099e4f033f4a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.853349 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6fe72f15-115d-4bbe-91d6-da73c833ae64 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:41.854255 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6fe72f15-115d-4bbe-91d6-da73c833ae64 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:41.860498 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fe72f15-115d-4bbe-91d6-da73c833ae64 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.861573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fe72f15-115d-4bbe-91d6-da73c833ae64 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.862365 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fe72f15-115d-4bbe-91d6-da73c833ae64 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:41.862798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fe72f15-115d-4bbe-91d6-da73c833ae64 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:41.892143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6fe72f15-115d-4bbe-91d6-da73c833ae64 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042568 Dec 15 19:06:41.896156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 294/617] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:06:41 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:06:41.906855 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0db85ef0-e156-4caa-9f6e-099e4f033f4a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:41.914971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0db85ef0-e156-4caa-9f6e-099e4f033f4a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.164713 Dec 15 19:06:41.915542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 324/618] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:41 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:42.359242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7e03529a-31ad-44fa-a9fd-0fc30ea04ed6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:42.359845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7e03529a-31ad-44fa-a9fd-0fc30ea04ed6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:42.365667 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7e03529a-31ad-44fa-a9fd-0fc30ea04ed6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.366111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7e03529a-31ad-44fa-a9fd-0fc30ea04ed6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.366883 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7e03529a-31ad-44fa-a9fd-0fc30ea04ed6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.367315 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7e03529a-31ad-44fa-a9fd-0fc30ea04ed6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.498640 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7e03529a-31ad-44fa-a9fd-0fc30ea04ed6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:42.507170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7e03529a-31ad-44fa-a9fd-0fc30ea04ed6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.151518 Dec 15 19:06:42.507733 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 295/619] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:42 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:42.611073 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:42.611680 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:42.618109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.618558 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.619344 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.619814 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.656540 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9eefa120-1e44-4abe-95cc-e115165aadeb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:42.657786 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9eefa120-1e44-4abe-95cc-e115165aadeb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:42.665286 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9eefa120-1e44-4abe-95cc-e115165aadeb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.665860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9eefa120-1e44-4abe-95cc-e115165aadeb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.666719 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9eefa120-1e44-4abe-95cc-e115165aadeb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.667248 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9eefa120-1e44-4abe-95cc-e115165aadeb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.754182 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:42.762667 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:42.764184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:42.765371 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-df310f2d-05e1-4c11-840f-6f8f3d31d626 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.158594 Dec 15 19:06:42.765974 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 325/620] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:42 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:42.771534 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-cf17dd80-dedf-494a-9ff4-0bf11eecd3c4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:42.772247 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-cf17dd80-dedf-494a-9ff4-0bf11eecd3c4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:42.780209 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cf17dd80-dedf-494a-9ff4-0bf11eecd3c4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.780668 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cf17dd80-dedf-494a-9ff4-0bf11eecd3c4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.781503 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cf17dd80-dedf-494a-9ff4-0bf11eecd3c4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.781944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cf17dd80-dedf-494a-9ff4-0bf11eecd3c4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.810391 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9eefa120-1e44-4abe-95cc-e115165aadeb tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 28703 microversion: 2.1 time: 0.157662 Dec 15 19:06:42.811187 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 296/621] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:42 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 28703 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:06:42.861407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cf17dd80-dedf-494a-9ff4-0bf11eecd3c4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:42.869005 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-cf17dd80-dedf-494a-9ff4-0bf11eecd3c4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1135 microversion: 2.1 time: 0.101616 Dec 15 19:06:42.869600 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 326/622] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:42 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1135 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:42.881519 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-93bcdc76-a57d-47d8-8b12-6bec57799dbe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:42.882190 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-93bcdc76-a57d-47d8-8b12-6bec57799dbe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:42.889320 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-93bcdc76-a57d-47d8-8b12-6bec57799dbe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.889859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-93bcdc76-a57d-47d8-8b12-6bec57799dbe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.890744 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-93bcdc76-a57d-47d8-8b12-6bec57799dbe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.891316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-93bcdc76-a57d-47d8-8b12-6bec57799dbe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.903644 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5e15e749-5537-4ac2-a47b-e93c9565312e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:42.904786 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5e15e749-5537-4ac2-a47b-e93c9565312e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:42.911596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e15e749-5537-4ac2-a47b-e93c9565312e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.912096 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e15e749-5537-4ac2-a47b-e93c9565312e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.912932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e15e749-5537-4ac2-a47b-e93c9565312e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.913406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e15e749-5537-4ac2-a47b-e93c9565312e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.919841 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-93bcdc76-a57d-47d8-8b12-6bec57799dbe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:06:42.944293 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5e15e749-5537-4ac2-a47b-e93c9565312e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044350 Dec 15 19:06:42.945193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 327/623] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:06:42 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:42.951770 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f57bdd33-5bf2-4527-9bd8-ce5651f25f75 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:42.952370 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f57bdd33-5bf2-4527-9bd8-ce5651f25f75 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:42.958207 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f57bdd33-5bf2-4527-9bd8-ce5651f25f75 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.958666 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f57bdd33-5bf2-4527-9bd8-ce5651f25f75 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:42.959545 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f57bdd33-5bf2-4527-9bd8-ce5651f25f75 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:42.959984 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f57bdd33-5bf2-4527-9bd8-ce5651f25f75 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.166242 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f57bdd33-5bf2-4527-9bd8-ce5651f25f75 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:43.171865 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f57bdd33-5bf2-4527-9bd8-ce5651f25f75 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.223471 Dec 15 19:06:43.182512 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 328/624] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:42 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:43.242976 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-93bcdc76-a57d-47d8-8b12-6bec57799dbe tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "DELETE /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 204 len: 0 microversion: 2.1 time: 0.366135 Dec 15 19:06:43.243848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 297/625] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:06:42 2021] DELETE /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:06:43.252161 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b7c8c61f-4609-495c-807d-c6ffd9a3cdeb tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:43.255049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b7c8c61f-4609-495c-807d-c6ffd9a3cdeb tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:43.263763 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b7c8c61f-4609-495c-807d-c6ffd9a3cdeb tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.264449 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b7c8c61f-4609-495c-807d-c6ffd9a3cdeb tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.266643 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b7c8c61f-4609-495c-807d-c6ffd9a3cdeb tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.267302 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b7c8c61f-4609-495c-807d-c6ffd9a3cdeb tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.500541 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b7c8c61f-4609-495c-807d-c6ffd9a3cdeb tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:43.510356 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b7c8c61f-4609-495c-807d-c6ffd9a3cdeb tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.261997 Dec 15 19:06:43.511139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 329/626] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:43 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:43.527889 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7a91602a-5a2d-4fd8-858c-0ed93a315bb6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:43.528594 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7a91602a-5a2d-4fd8-858c-0ed93a315bb6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:43.538920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7a91602a-5a2d-4fd8-858c-0ed93a315bb6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.539360 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7a91602a-5a2d-4fd8-858c-0ed93a315bb6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.540368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7a91602a-5a2d-4fd8-858c-0ed93a315bb6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.540957 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7a91602a-5a2d-4fd8-858c-0ed93a315bb6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.719314 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7a91602a-5a2d-4fd8-858c-0ed93a315bb6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:43.728393 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7a91602a-5a2d-4fd8-858c-0ed93a315bb6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.204680 Dec 15 19:06:43.729167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 298/627] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:43 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:43.784245 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:43.784857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:43.790811 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.791264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.793357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.793357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.823111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-974a8c41-7f43-48c6-acf4-cd57b4eb1f7a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:43.824528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-974a8c41-7f43-48c6-acf4-cd57b4eb1f7a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:43.831359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-974a8c41-7f43-48c6-acf4-cd57b4eb1f7a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.831875 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-974a8c41-7f43-48c6-acf4-cd57b4eb1f7a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.832779 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-974a8c41-7f43-48c6-acf4-cd57b4eb1f7a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.833324 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-974a8c41-7f43-48c6-acf4-cd57b4eb1f7a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.929371 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-974a8c41-7f43-48c6-acf4-cd57b4eb1f7a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 28703 microversion: 2.1 time: 0.109945 Dec 15 19:06:43.930922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 299/628] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:43 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 28703 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:06:43.936554 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-cf16a329-71dd-4782-b09a-c8f93dbfc96f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:43.937762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-cf16a329-71dd-4782-b09a-c8f93dbfc96f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:43.947432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf16a329-71dd-4782-b09a-c8f93dbfc96f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.948230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf16a329-71dd-4782-b09a-c8f93dbfc96f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.951521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf16a329-71dd-4782-b09a-c8f93dbfc96f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:43.951521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf16a329-71dd-4782-b09a-c8f93dbfc96f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:43.964685 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:43.975246 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:43.978423 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:43.979916 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-cd0ae160-c911-4d85-9522-6a69d6977495 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.200081 Dec 15 19:06:43.999814 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 330/629] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:43 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:43.999814 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ea30d70e-4094-4d56-854c-01505a9433dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:43.999814 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ea30d70e-4094-4d56-854c-01505a9433dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:43.999814 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ea30d70e-4094-4d56-854c-01505a9433dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.000353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ea30d70e-4094-4d56-854c-01505a9433dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.000353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ea30d70e-4094-4d56-854c-01505a9433dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.000353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ea30d70e-4094-4d56-854c-01505a9433dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.035076 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ea30d70e-4094-4d56-854c-01505a9433dd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048385 Dec 15 19:06:44.035648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 331/630] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:06:43 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:06:44.061113 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-cf16a329-71dd-4782-b09a-c8f93dbfc96f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:44.071005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-cf16a329-71dd-4782-b09a-c8f93dbfc96f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1199 microversion: 2.1 time: 0.138662 Dec 15 19:06:44.073357 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 300/631] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:43 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1199 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:44.192368 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a7d5f8d1-b1ca-4c80-8888-72adb88f42cf tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:44.194826 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a7d5f8d1-b1ca-4c80-8888-72adb88f42cf tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:44.203319 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7d5f8d1-b1ca-4c80-8888-72adb88f42cf tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.203763 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7d5f8d1-b1ca-4c80-8888-72adb88f42cf tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.205018 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7d5f8d1-b1ca-4c80-8888-72adb88f42cf tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.205682 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a7d5f8d1-b1ca-4c80-8888-72adb88f42cf tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.372024 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a7d5f8d1-b1ca-4c80-8888-72adb88f42cf tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:44.375793 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a7d5f8d1-b1ca-4c80-8888-72adb88f42cf tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.189701 Dec 15 19:06:44.377011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 332/632] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:44 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:44.503653 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-fc12837b-4e0d-4616-b0d1-1784c3a605c3 req-deef4e1f-43e8-416e-9d87-6455531ed60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848dbdaf-18c0-4beb-a74b-5b6d09d5911f", "name": "network-vif-plugged", "status": "completed", "tag": "6ebe1443-a187-419b-b3fd-548c8b30dbb0"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:44.506144 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:06:44.506144 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:06:44.517628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-fc12837b-4e0d-4616-b0d1-1784c3a605c3 req-deef4e1f-43e8-416e-9d87-6455531ed60e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.518210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-fc12837b-4e0d-4616-b0d1-1784c3a605c3 req-deef4e1f-43e8-416e-9d87-6455531ed60e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.530436 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-057b9adb-5047-46e7-8f29-6da30429f626 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:44.531163 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-057b9adb-5047-46e7-8f29-6da30429f626 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:44.545067 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-057b9adb-5047-46e7-8f29-6da30429f626 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.545644 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-057b9adb-5047-46e7-8f29-6da30429f626 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.546713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-057b9adb-5047-46e7-8f29-6da30429f626 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.547232 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-057b9adb-5047-46e7-8f29-6da30429f626 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.553643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-fc12837b-4e0d-4616-b0d1-1784c3a605c3 req-deef4e1f-43e8-416e-9d87-6455531ed60e service nova] Creating event network-vif-plugged:6ebe1443-a187-419b-b3fd-548c8b30dbb0 for instance 848dbdaf-18c0-4beb-a74b-5b6d09d5911f on hv-cinder-81268 Dec 15 19:06:44.563791 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-fc12837b-4e0d-4616-b0d1-1784c3a605c3 req-deef4e1f-43e8-416e-9d87-6455531ed60e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065133 Dec 15 19:06:44.572465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 301/633] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:06:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:06:44.726254 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-057b9adb-5047-46e7-8f29-6da30429f626 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:44.735046 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-057b9adb-5047-46e7-8f29-6da30429f626 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.208809 Dec 15 19:06:44.736905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 333/634] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:44 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:44.752752 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-aa5bf6e9-a896-40d5-8ba6-f08e0ebc9fbc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:44.753737 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-aa5bf6e9-a896-40d5-8ba6-f08e0ebc9fbc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:44.759972 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aa5bf6e9-a896-40d5-8ba6-f08e0ebc9fbc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.760415 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aa5bf6e9-a896-40d5-8ba6-f08e0ebc9fbc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.762096 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aa5bf6e9-a896-40d5-8ba6-f08e0ebc9fbc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.762096 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aa5bf6e9-a896-40d5-8ba6-f08e0ebc9fbc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.942647 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-52eb42f3-15b7-49a7-a73e-3d04b25c1958 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:44.944443 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-52eb42f3-15b7-49a7-a73e-3d04b25c1958 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:44.952608 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-52eb42f3-15b7-49a7-a73e-3d04b25c1958 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.953058 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-52eb42f3-15b7-49a7-a73e-3d04b25c1958 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:44.953914 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-52eb42f3-15b7-49a7-a73e-3d04b25c1958 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:44.955050 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-52eb42f3-15b7-49a7-a73e-3d04b25c1958 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.012159 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-aa5bf6e9-a896-40d5-8ba6-f08e0ebc9fbc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:45.024293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-aa5bf6e9-a896-40d5-8ba6-f08e0ebc9fbc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.276525 Dec 15 19:06:45.028596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 302/635] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:44 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:45.044734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:45.045531 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:45.052641 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.053120 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.054128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.054560 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.215811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:45.227547 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:45.229042 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:45.230448 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3ba11f56-62e9-4825-8370-b35b6e884674 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.200561 Dec 15 19:06:45.242180 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 303/636] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:45 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:45.255528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b061be38-c569-4ae7-bfda-0c8a9957c3e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:45.256149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b061be38-c569-4ae7-bfda-0c8a9957c3e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:45.263691 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b061be38-c569-4ae7-bfda-0c8a9957c3e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.264362 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b061be38-c569-4ae7-bfda-0c8a9957c3e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.266198 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b061be38-c569-4ae7-bfda-0c8a9957c3e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.267410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b061be38-c569-4ae7-bfda-0c8a9957c3e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.432998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b061be38-c569-4ae7-bfda-0c8a9957c3e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:45.441871 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b061be38-c569-4ae7-bfda-0c8a9957c3e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.198227 Dec 15 19:06:45.442458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 304/637] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:45 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:45.447130 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f73c3218-6d64-4bec-8a3d-74dca8d5260c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:45.447942 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f73c3218-6d64-4bec-8a3d-74dca8d5260c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:45.454337 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f73c3218-6d64-4bec-8a3d-74dca8d5260c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.457675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f73c3218-6d64-4bec-8a3d-74dca8d5260c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.458518 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f73c3218-6d64-4bec-8a3d-74dca8d5260c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.458957 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f73c3218-6d64-4bec-8a3d-74dca8d5260c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.596181 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f73c3218-6d64-4bec-8a3d-74dca8d5260c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:45.606859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f73c3218-6d64-4bec-8a3d-74dca8d5260c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.163179 Dec 15 19:06:45.610316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 305/638] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:45 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:45.620947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-db9e2fb0-4ddc-4c85-b2d5-abeb80142e96 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:45.621745 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-db9e2fb0-4ddc-4c85-b2d5-abeb80142e96 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:45.628551 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db9e2fb0-4ddc-4c85-b2d5-abeb80142e96 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.629002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db9e2fb0-4ddc-4c85-b2d5-abeb80142e96 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.629817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db9e2fb0-4ddc-4c85-b2d5-abeb80142e96 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.630246 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-db9e2fb0-4ddc-4c85-b2d5-abeb80142e96 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.656088 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-db9e2fb0-4ddc-4c85-b2d5-abeb80142e96 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:06:45.914091 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-db9e2fb0-4ddc-4c85-b2d5-abeb80142e96 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 204 len: 0 microversion: 2.1 time: 0.296336 Dec 15 19:06:45.914601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 306/639] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:06:45 2021] DELETE /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:06:45.919441 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-63616f4d-4998-40e8-9340-a43d1d774557 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:45.920181 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-63616f4d-4998-40e8-9340-a43d1d774557 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:45.926591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-63616f4d-4998-40e8-9340-a43d1d774557 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.927031 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-63616f4d-4998-40e8-9340-a43d1d774557 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:45.927796 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-63616f4d-4998-40e8-9340-a43d1d774557 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:45.928226 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-63616f4d-4998-40e8-9340-a43d1d774557 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.066721 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-63616f4d-4998-40e8-9340-a43d1d774557 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:46.074217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-63616f4d-4998-40e8-9340-a43d1d774557 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.158499 Dec 15 19:06:46.074792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 307/640] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:45 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:46.078992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-579b573c-9726-4e19-9871-19c1cb9c1968 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:46.079826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-579b573c-9726-4e19-9871-19c1cb9c1968 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:46.085831 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-579b573c-9726-4e19-9871-19c1cb9c1968 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.086280 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-579b573c-9726-4e19-9871-19c1cb9c1968 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.087067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-579b573c-9726-4e19-9871-19c1cb9c1968 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.087534 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-579b573c-9726-4e19-9871-19c1cb9c1968 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.221227 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-579b573c-9726-4e19-9871-19c1cb9c1968 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:46.228605 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-579b573c-9726-4e19-9871-19c1cb9c1968 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.152877 Dec 15 19:06:46.229191 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 308/641] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:46 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:46.233470 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-76cb869b-c795-43c5-898f-188395c82e07 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:46.234067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-76cb869b-c795-43c5-898f-188395c82e07 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:46.240111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-76cb869b-c795-43c5-898f-188395c82e07 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.240564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-76cb869b-c795-43c5-898f-188395c82e07 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.241372 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-76cb869b-c795-43c5-898f-188395c82e07 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.241811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-76cb869b-c795-43c5-898f-188395c82e07 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.383071 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-76cb869b-c795-43c5-898f-188395c82e07 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:46.390947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-76cb869b-c795-43c5-898f-188395c82e07 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.160820 Dec 15 19:06:46.391798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 309/642] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:46 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:46.397272 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:46.397864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:46.403320 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.403987 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.404535 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.404961 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.542228 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:46.551081 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:46.552601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:46.554076 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-763eb9b2-f2cd-47a8-a632-d5cb69330357 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.160702 Dec 15 19:06:46.554635 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 310/643] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:46 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:46.558909 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6088b950-7c9f-48fb-8102-8717d08a17ad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:46.559503 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6088b950-7c9f-48fb-8102-8717d08a17ad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:46.565640 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6088b950-7c9f-48fb-8102-8717d08a17ad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.566105 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6088b950-7c9f-48fb-8102-8717d08a17ad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.566899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6088b950-7c9f-48fb-8102-8717d08a17ad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.567329 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6088b950-7c9f-48fb-8102-8717d08a17ad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.699181 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6088b950-7c9f-48fb-8102-8717d08a17ad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:46.706448 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6088b950-7c9f-48fb-8102-8717d08a17ad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.150879 Dec 15 19:06:46.710014 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 311/644] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:46 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:46.711389 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a3dec6e4-0c40-447a-ad2a-69d1761834f7 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:46.711993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a3dec6e4-0c40-447a-ad2a-69d1761834f7 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:46.717883 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3dec6e4-0c40-447a-ad2a-69d1761834f7 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.718330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3dec6e4-0c40-447a-ad2a-69d1761834f7 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.719295 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3dec6e4-0c40-447a-ad2a-69d1761834f7 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:46.719737 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3dec6e4-0c40-447a-ad2a-69d1761834f7 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:46.851470 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a3dec6e4-0c40-447a-ad2a-69d1761834f7 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:46.859482 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a3dec6e4-0c40-447a-ad2a-69d1761834f7 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.151325 Dec 15 19:06:46.860273 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 312/645] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:46 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:47.093098 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2b224acb-075c-43cc-9183-20de6c3fd41c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:47.094024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2b224acb-075c-43cc-9183-20de6c3fd41c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:47.100758 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b224acb-075c-43cc-9183-20de6c3fd41c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.101332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b224acb-075c-43cc-9183-20de6c3fd41c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.102225 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b224acb-075c-43cc-9183-20de6c3fd41c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.102890 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b224acb-075c-43cc-9183-20de6c3fd41c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.236437 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2b224acb-075c-43cc-9183-20de6c3fd41c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:47.246203 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2b224acb-075c-43cc-9183-20de6c3fd41c tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.157135 Dec 15 19:06:47.246973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 313/646] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:47 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:47.259364 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f4076501-fafb-4ef5-84f1-8faf501f8dc4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:47.260054 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f4076501-fafb-4ef5-84f1-8faf501f8dc4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:47.266298 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f4076501-fafb-4ef5-84f1-8faf501f8dc4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.266517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f4076501-fafb-4ef5-84f1-8faf501f8dc4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.267797 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f4076501-fafb-4ef5-84f1-8faf501f8dc4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.268230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f4076501-fafb-4ef5-84f1-8faf501f8dc4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.403966 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f4076501-fafb-4ef5-84f1-8faf501f8dc4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:47.409501 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f4076501-fafb-4ef5-84f1-8faf501f8dc4 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.153731 Dec 15 19:06:47.410070 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 314/647] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:47 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:47.414519 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-24d2dd6a-63e1-494b-b860-405d91f5958f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:47.415158 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-24d2dd6a-63e1-494b-b860-405d91f5958f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:47.421409 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-24d2dd6a-63e1-494b-b860-405d91f5958f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.421861 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-24d2dd6a-63e1-494b-b860-405d91f5958f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.422689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-24d2dd6a-63e1-494b-b860-405d91f5958f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.423267 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-24d2dd6a-63e1-494b-b860-405d91f5958f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.560200 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-24d2dd6a-63e1-494b-b860-405d91f5958f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:47.569112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-24d2dd6a-63e1-494b-b860-405d91f5958f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.157995 Dec 15 19:06:47.569698 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 315/648] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:47 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:47.573969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:47.574575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:47.580896 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.591147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.591147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.591147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.717301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:47.725620 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:47.727122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:47.728271 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-eb58393e-9f4e-4311-ba32-c28fcd99b407 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.157662 Dec 15 19:06:47.728826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 316/649] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:47 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:47.734545 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e9058824-3c47-48a6-9ff1-a25de1d66e20 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:47.734545 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e9058824-3c47-48a6-9ff1-a25de1d66e20 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:47.739814 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e9058824-3c47-48a6-9ff1-a25de1d66e20 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.740271 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e9058824-3c47-48a6-9ff1-a25de1d66e20 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.741055 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e9058824-3c47-48a6-9ff1-a25de1d66e20 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.741511 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e9058824-3c47-48a6-9ff1-a25de1d66e20 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.875528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e9058824-3c47-48a6-9ff1-a25de1d66e20 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:47.883812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e9058824-3c47-48a6-9ff1-a25de1d66e20 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.153956 Dec 15 19:06:47.884578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 317/650] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:47 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:47.888726 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-72094046-4ac7-4bd7-92d3-b5ef081c582a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:47.889426 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-72094046-4ac7-4bd7-92d3-b5ef081c582a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:47.896110 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72094046-4ac7-4bd7-92d3-b5ef081c582a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.896602 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72094046-4ac7-4bd7-92d3-b5ef081c582a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:47.897381 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72094046-4ac7-4bd7-92d3-b5ef081c582a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:47.897816 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72094046-4ac7-4bd7-92d3-b5ef081c582a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.030202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-72094046-4ac7-4bd7-92d3-b5ef081c582a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:48.037429 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-72094046-4ac7-4bd7-92d3-b5ef081c582a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.152060 Dec 15 19:06:48.037995 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 318/651] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:47 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:48.263555 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0787dc24-db52-4e30-9894-9898aa17bec0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:48.264169 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0787dc24-db52-4e30-9894-9898aa17bec0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:48.271149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0787dc24-db52-4e30-9894-9898aa17bec0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.271639 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0787dc24-db52-4e30-9894-9898aa17bec0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.272421 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0787dc24-db52-4e30-9894-9898aa17bec0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.272851 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0787dc24-db52-4e30-9894-9898aa17bec0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.403262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0787dc24-db52-4e30-9894-9898aa17bec0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:48.411319 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0787dc24-db52-4e30-9894-9898aa17bec0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.151375 Dec 15 19:06:48.411888 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 319/652] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:48 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:48.426776 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-855347a9-a8c4-466e-acac-3c0d19123470 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:48.427405 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-855347a9-a8c4-466e-acac-3c0d19123470 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:48.436764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-855347a9-a8c4-466e-acac-3c0d19123470 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.437252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-855347a9-a8c4-466e-acac-3c0d19123470 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.438047 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-855347a9-a8c4-466e-acac-3c0d19123470 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.438498 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-855347a9-a8c4-466e-acac-3c0d19123470 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.577259 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-855347a9-a8c4-466e-acac-3c0d19123470 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:48.584948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-855347a9-a8c4-466e-acac-3c0d19123470 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.162330 Dec 15 19:06:48.585537 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 320/653] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:48 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:48.589817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e6dcc150-de69-4850-a429-82ba526cd994 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:48.590408 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e6dcc150-de69-4850-a429-82ba526cd994 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:48.596381 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e6dcc150-de69-4850-a429-82ba526cd994 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.596831 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e6dcc150-de69-4850-a429-82ba526cd994 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.597683 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e6dcc150-de69-4850-a429-82ba526cd994 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.598128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e6dcc150-de69-4850-a429-82ba526cd994 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.738368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e6dcc150-de69-4850-a429-82ba526cd994 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:48.753914 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e6dcc150-de69-4850-a429-82ba526cd994 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.167261 Dec 15 19:06:48.755156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 321/654] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:48 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:48.761969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:48.762578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:48.769838 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.770356 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.771084 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.771516 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.908171 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:48.916576 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:48.918102 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:48.919242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9c6f9ea8-daf6-4858-9b1e-deb390a9098d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.163844 Dec 15 19:06:48.920182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 322/655] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:48 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:48.924067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-72dc70f9-7cf9-4ad9-abe6-702e0184c695 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:48.924666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-72dc70f9-7cf9-4ad9-abe6-702e0184c695 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:48.930560 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72dc70f9-7cf9-4ad9-abe6-702e0184c695 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.931014 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72dc70f9-7cf9-4ad9-abe6-702e0184c695 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:48.931798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72dc70f9-7cf9-4ad9-abe6-702e0184c695 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:48.932232 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72dc70f9-7cf9-4ad9-abe6-702e0184c695 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.066800 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-72dc70f9-7cf9-4ad9-abe6-702e0184c695 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:49.074089 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-72dc70f9-7cf9-4ad9-abe6-702e0184c695 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.153351 Dec 15 19:06:49.074675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 323/656] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:48 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:49.080557 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-49760a02-38dd-4d3d-9fc1-404aace9af9d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:49.081187 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-49760a02-38dd-4d3d-9fc1-404aace9af9d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:49.086579 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-49760a02-38dd-4d3d-9fc1-404aace9af9d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.087024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-49760a02-38dd-4d3d-9fc1-404aace9af9d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.087794 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-49760a02-38dd-4d3d-9fc1-404aace9af9d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.088222 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-49760a02-38dd-4d3d-9fc1-404aace9af9d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.217954 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-49760a02-38dd-4d3d-9fc1-404aace9af9d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:49.225220 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-49760a02-38dd-4d3d-9fc1-404aace9af9d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.148882 Dec 15 19:06:49.225783 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 324/657] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:49 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:49.428801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f04d2cb2-e130-41b3-b47e-48764452e464 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:49.429360 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f04d2cb2-e130-41b3-b47e-48764452e464 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:49.435221 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f04d2cb2-e130-41b3-b47e-48764452e464 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.435666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f04d2cb2-e130-41b3-b47e-48764452e464 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.436446 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f04d2cb2-e130-41b3-b47e-48764452e464 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.436880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f04d2cb2-e130-41b3-b47e-48764452e464 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.569355 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f04d2cb2-e130-41b3-b47e-48764452e464 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:49.577762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f04d2cb2-e130-41b3-b47e-48764452e464 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.153199 Dec 15 19:06:49.578587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 325/658] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:49 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:49.604512 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d141fd36-00a5-409a-8fb8-3a401b34084c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:49.605155 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d141fd36-00a5-409a-8fb8-3a401b34084c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:49.611698 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d141fd36-00a5-409a-8fb8-3a401b34084c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.612147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d141fd36-00a5-409a-8fb8-3a401b34084c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.612929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d141fd36-00a5-409a-8fb8-3a401b34084c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.613403 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d141fd36-00a5-409a-8fb8-3a401b34084c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.778358 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d141fd36-00a5-409a-8fb8-3a401b34084c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:49.799763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d141fd36-00a5-409a-8fb8-3a401b34084c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.198720 Dec 15 19:06:49.800591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 326/659] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:49 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:49.811517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-75c6d113-00c3-485c-ad10-72e1108b7d87 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:49.812138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-75c6d113-00c3-485c-ad10-72e1108b7d87 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:49.819043 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-75c6d113-00c3-485c-ad10-72e1108b7d87 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.820630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-75c6d113-00c3-485c-ad10-72e1108b7d87 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.820630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-75c6d113-00c3-485c-ad10-72e1108b7d87 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.820810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-75c6d113-00c3-485c-ad10-72e1108b7d87 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.971191 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-75c6d113-00c3-485c-ad10-72e1108b7d87 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:49.980721 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-75c6d113-00c3-485c-ad10-72e1108b7d87 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.175492 Dec 15 19:06:49.981422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 327/660] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:49 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:49.987721 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:49.988453 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:49.995332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.995783 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:49.996676 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:49.997157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:50.155639 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:50.164004 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:50.165989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:50.167453 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2b420a27-4c3a-4af6-83cb-8dbaa591ff14 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.184805 Dec 15 19:06:50.168158 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 328/661] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:49 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:50.173869 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b909628c-ec55-45c1-b10a-0714140c148a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:50.174535 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b909628c-ec55-45c1-b10a-0714140c148a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:50.180470 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b909628c-ec55-45c1-b10a-0714140c148a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:50.180930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b909628c-ec55-45c1-b10a-0714140c148a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:50.181779 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b909628c-ec55-45c1-b10a-0714140c148a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:50.182218 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b909628c-ec55-45c1-b10a-0714140c148a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:50.324242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b909628c-ec55-45c1-b10a-0714140c148a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:50.332372 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b909628c-ec55-45c1-b10a-0714140c148a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.163120 Dec 15 19:06:50.333011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 329/662] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:50 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:50.337564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4bcda28f-4c00-41f6-b0bc-dc5766df925a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:50.338171 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4bcda28f-4c00-41f6-b0bc-dc5766df925a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:50.344073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4bcda28f-4c00-41f6-b0bc-dc5766df925a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:50.344523 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4bcda28f-4c00-41f6-b0bc-dc5766df925a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:50.346063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4bcda28f-4c00-41f6-b0bc-dc5766df925a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:50.346599 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4bcda28f-4c00-41f6-b0bc-dc5766df925a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:50.485293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4bcda28f-4c00-41f6-b0bc-dc5766df925a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:50.492417 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4bcda28f-4c00-41f6-b0bc-dc5766df925a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.158285 Dec 15 19:06:50.492984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 330/663] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:50 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:50.607348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-cf6d357b-3c51-41b9-bc7e-52a3b7ae83b7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:50.607866 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-cf6d357b-3c51-41b9-bc7e-52a3b7ae83b7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:50.614348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf6d357b-3c51-41b9-bc7e-52a3b7ae83b7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:50.620433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf6d357b-3c51-41b9-bc7e-52a3b7ae83b7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:50.620433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf6d357b-3c51-41b9-bc7e-52a3b7ae83b7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:50.620433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf6d357b-3c51-41b9-bc7e-52a3b7ae83b7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:50.748512 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-cf6d357b-3c51-41b9-bc7e-52a3b7ae83b7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:50.756614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-cf6d357b-3c51-41b9-bc7e-52a3b7ae83b7 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.153009 Dec 15 19:06:50.757352 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 331/664] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:50 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:50.816454 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3ea8e78e-ee2a-47ef-9590-3632b0059d76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:50.817165 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3ea8e78e-ee2a-47ef-9590-3632b0059d76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:50.823260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3ea8e78e-ee2a-47ef-9590-3632b0059d76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:50.823700 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3ea8e78e-ee2a-47ef-9590-3632b0059d76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:50.824628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3ea8e78e-ee2a-47ef-9590-3632b0059d76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:50.825173 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3ea8e78e-ee2a-47ef-9590-3632b0059d76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:50.972522 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3ea8e78e-ee2a-47ef-9590-3632b0059d76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:50.979868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3ea8e78e-ee2a-47ef-9590-3632b0059d76 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.167579 Dec 15 19:06:50.980442 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 332/665] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:50 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:50.998571 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-64a5c38c-b20d-48ae-9f61-3f78933d81e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:50.999177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-64a5c38c-b20d-48ae-9f61-3f78933d81e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:51.006160 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64a5c38c-b20d-48ae-9f61-3f78933d81e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.006605 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64a5c38c-b20d-48ae-9f61-3f78933d81e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.007392 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64a5c38c-b20d-48ae-9f61-3f78933d81e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.007822 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64a5c38c-b20d-48ae-9f61-3f78933d81e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.139853 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-64a5c38c-b20d-48ae-9f61-3f78933d81e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:51.147792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-64a5c38c-b20d-48ae-9f61-3f78933d81e9 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.152852 Dec 15 19:06:51.148363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 333/666] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:50 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:51.186409 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:51.186937 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:51.193568 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.193998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.194900 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.195358 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.332277 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:51.340527 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:51.342062 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:51.343203 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f590ee1d-6c61-4d87-9ce4-70efa17d0617 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.160650 Dec 15 19:06:51.343765 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 334/667] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:51 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:51.348973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4f583c1e-64f5-4fab-904e-9c69b623903a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:51.349595 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4f583c1e-64f5-4fab-904e-9c69b623903a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:51.355060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4f583c1e-64f5-4fab-904e-9c69b623903a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.355506 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4f583c1e-64f5-4fab-904e-9c69b623903a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.356272 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4f583c1e-64f5-4fab-904e-9c69b623903a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.356704 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4f583c1e-64f5-4fab-904e-9c69b623903a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.493559 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4f583c1e-64f5-4fab-904e-9c69b623903a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:51.501537 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4f583c1e-64f5-4fab-904e-9c69b623903a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.155677 Dec 15 19:06:51.502109 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 335/668] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:51 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:51.509279 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e7ab73c1-ecf0-48a5-ac9c-c9ce543a00d9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:51.509959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e7ab73c1-ecf0-48a5-ac9c-c9ce543a00d9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:51.516290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e7ab73c1-ecf0-48a5-ac9c-c9ce543a00d9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.516749 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e7ab73c1-ecf0-48a5-ac9c-c9ce543a00d9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.517570 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e7ab73c1-ecf0-48a5-ac9c-c9ce543a00d9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.518010 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e7ab73c1-ecf0-48a5-ac9c-c9ce543a00d9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.650545 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e7ab73c1-ecf0-48a5-ac9c-c9ce543a00d9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:51.658389 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e7ab73c1-ecf0-48a5-ac9c-c9ce543a00d9 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.152589 Dec 15 19:06:51.659233 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 336/669] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:51 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:51.774493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-adcf42ac-e04d-4a56-bc85-fac84451d24f tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:51.775097 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-adcf42ac-e04d-4a56-bc85-fac84451d24f tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:51.780959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-adcf42ac-e04d-4a56-bc85-fac84451d24f tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.781434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-adcf42ac-e04d-4a56-bc85-fac84451d24f tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.782872 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-adcf42ac-e04d-4a56-bc85-fac84451d24f tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:51.783304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-adcf42ac-e04d-4a56-bc85-fac84451d24f tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:51.920953 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-adcf42ac-e04d-4a56-bc85-fac84451d24f tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:51.929142 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-adcf42ac-e04d-4a56-bc85-fac84451d24f tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.158195 Dec 15 19:06:51.930553 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 337/670] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:51 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:51.996407 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d3576156-3317-4ad9-a523-54d1c55689b7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:51.997026 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d3576156-3317-4ad9-a523-54d1c55689b7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:52.003489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d3576156-3317-4ad9-a523-54d1c55689b7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.003942 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d3576156-3317-4ad9-a523-54d1c55689b7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.004738 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d3576156-3317-4ad9-a523-54d1c55689b7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.005218 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d3576156-3317-4ad9-a523-54d1c55689b7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.148833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d3576156-3317-4ad9-a523-54d1c55689b7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:52.156510 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d3576156-3317-4ad9-a523-54d1c55689b7 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.163795 Dec 15 19:06:52.157679 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 338/671] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:51 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:52.163616 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e39f2532-1115-48e1-8ac0-598790ea286b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:52.164318 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e39f2532-1115-48e1-8ac0-598790ea286b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:52.170292 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e39f2532-1115-48e1-8ac0-598790ea286b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.170741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e39f2532-1115-48e1-8ac0-598790ea286b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.171514 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e39f2532-1115-48e1-8ac0-598790ea286b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.171948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e39f2532-1115-48e1-8ac0-598790ea286b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.311882 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e39f2532-1115-48e1-8ac0-598790ea286b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:52.320044 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e39f2532-1115-48e1-8ac0-598790ea286b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.159785 Dec 15 19:06:52.320618 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 339/672] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:52 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:52.362572 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:52.363090 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:52.369184 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.369613 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.370376 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.370801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.504937 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:52.513244 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:52.515242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:52.516894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-056124bd-3ace-48e4-97f2-f005ba96b4da tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.158503 Dec 15 19:06:52.517484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 340/673] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:52 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:52.522153 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ea2de941-ba72-43fb-93bd-eaeb433b10a0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:52.522746 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ea2de941-ba72-43fb-93bd-eaeb433b10a0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:52.528260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea2de941-ba72-43fb-93bd-eaeb433b10a0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.528710 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea2de941-ba72-43fb-93bd-eaeb433b10a0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.529551 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea2de941-ba72-43fb-93bd-eaeb433b10a0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.530148 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ea2de941-ba72-43fb-93bd-eaeb433b10a0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.677597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ea2de941-ba72-43fb-93bd-eaeb433b10a0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:52.677759 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ea2de941-ba72-43fb-93bd-eaeb433b10a0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.159221 Dec 15 19:06:52.678274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 341/674] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:52 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:52.684708 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-44b15cbd-7e2f-400c-9b48-2b16efcf487c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:52.684708 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-44b15cbd-7e2f-400c-9b48-2b16efcf487c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:52.689672 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-44b15cbd-7e2f-400c-9b48-2b16efcf487c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.690372 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-44b15cbd-7e2f-400c-9b48-2b16efcf487c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.691212 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-44b15cbd-7e2f-400c-9b48-2b16efcf487c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.691653 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-44b15cbd-7e2f-400c-9b48-2b16efcf487c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.847857 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-44b15cbd-7e2f-400c-9b48-2b16efcf487c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:52.855601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-44b15cbd-7e2f-400c-9b48-2b16efcf487c tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.176324 Dec 15 19:06:52.856188 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 342/675] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:52 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:52.946012 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2314705e-a509-4c22-aeab-713890aa4013 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:52.946694 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2314705e-a509-4c22-aeab-713890aa4013 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:52.952762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2314705e-a509-4c22-aeab-713890aa4013 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.953368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2314705e-a509-4c22-aeab-713890aa4013 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:52.954812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2314705e-a509-4c22-aeab-713890aa4013 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:52.955323 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2314705e-a509-4c22-aeab-713890aa4013 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.087499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2314705e-a509-4c22-aeab-713890aa4013 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:53.094937 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2314705e-a509-4c22-aeab-713890aa4013 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.152634 Dec 15 19:06:53.095689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 343/676] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:52 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:53.174697 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0bb3d93d-9d5e-4932-9f96-f00afb0fcc77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:53.175431 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0bb3d93d-9d5e-4932-9f96-f00afb0fcc77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:53.181660 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0bb3d93d-9d5e-4932-9f96-f00afb0fcc77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.182110 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0bb3d93d-9d5e-4932-9f96-f00afb0fcc77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.182892 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0bb3d93d-9d5e-4932-9f96-f00afb0fcc77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.183328 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0bb3d93d-9d5e-4932-9f96-f00afb0fcc77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.324696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0bb3d93d-9d5e-4932-9f96-f00afb0fcc77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:53.332124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0bb3d93d-9d5e-4932-9f96-f00afb0fcc77 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.161786 Dec 15 19:06:53.333543 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 344/677] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:53 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:53.337124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e3694aa0-ca2d-426c-8084-b36f3e2440f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:53.337852 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e3694aa0-ca2d-426c-8084-b36f3e2440f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:53.345167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e3694aa0-ca2d-426c-8084-b36f3e2440f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.345688 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e3694aa0-ca2d-426c-8084-b36f3e2440f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.346636 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e3694aa0-ca2d-426c-8084-b36f3e2440f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.347149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e3694aa0-ca2d-426c-8084-b36f3e2440f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.487186 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e3694aa0-ca2d-426c-8084-b36f3e2440f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:53.495297 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e3694aa0-ca2d-426c-8084-b36f3e2440f6 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.161474 Dec 15 19:06:53.496052 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 345/678] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:53 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:53.533943 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:53.534470 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:53.540337 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.540779 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.541575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.542002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.684769 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:53.693654 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:53.695170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:53.696323 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ec4bb814-c7cd-4ced-a9f1-de082ac05684 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.166213 Dec 15 19:06:53.707773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 346/679] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:53 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:53.707773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-163b67a2-0ab2-40fb-9713-3ac34fa712be tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:53.707773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-163b67a2-0ab2-40fb-9713-3ac34fa712be tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:53.710569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-163b67a2-0ab2-40fb-9713-3ac34fa712be tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.710569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-163b67a2-0ab2-40fb-9713-3ac34fa712be tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.710569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-163b67a2-0ab2-40fb-9713-3ac34fa712be tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.710569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-163b67a2-0ab2-40fb-9713-3ac34fa712be tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.853615 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-163b67a2-0ab2-40fb-9713-3ac34fa712be tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:53.861401 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-163b67a2-0ab2-40fb-9713-3ac34fa712be tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.163383 Dec 15 19:06:53.861967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 347/680] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:53 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:53.871511 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4898b5eb-48c7-49b9-a490-b49286e4d40e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:53.872105 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4898b5eb-48c7-49b9-a490-b49286e4d40e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:53.878043 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4898b5eb-48c7-49b9-a490-b49286e4d40e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.878483 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4898b5eb-48c7-49b9-a490-b49286e4d40e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:53.879252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4898b5eb-48c7-49b9-a490-b49286e4d40e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:53.879681 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4898b5eb-48c7-49b9-a490-b49286e4d40e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.017655 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4898b5eb-48c7-49b9-a490-b49286e4d40e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:54.025046 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4898b5eb-48c7-49b9-a490-b49286e4d40e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.156813 Dec 15 19:06:54.025648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 348/681] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:53 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:54.112048 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-79726775-f068-4880-b1fd-645ed0951987 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:54.112794 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-79726775-f068-4880-b1fd-645ed0951987 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:54.119212 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79726775-f068-4880-b1fd-645ed0951987 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.119656 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79726775-f068-4880-b1fd-645ed0951987 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.120439 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79726775-f068-4880-b1fd-645ed0951987 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.120872 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79726775-f068-4880-b1fd-645ed0951987 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.255543 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-79726775-f068-4880-b1fd-645ed0951987 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:54.263028 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-79726775-f068-4880-b1fd-645ed0951987 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.155092 Dec 15 19:06:54.263790 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 349/682] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:54 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:54.348569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d130f310-6bfe-400d-a5f1-dd11f4954477 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:54.349251 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d130f310-6bfe-400d-a5f1-dd11f4954477 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:54.355317 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d130f310-6bfe-400d-a5f1-dd11f4954477 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.355763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d130f310-6bfe-400d-a5f1-dd11f4954477 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.356540 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d130f310-6bfe-400d-a5f1-dd11f4954477 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.356972 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d130f310-6bfe-400d-a5f1-dd11f4954477 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.491641 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d130f310-6bfe-400d-a5f1-dd11f4954477 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:54.499018 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d130f310-6bfe-400d-a5f1-dd11f4954477 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.154205 Dec 15 19:06:54.499715 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 350/683] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:54 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:54.511894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-df6b1593-6aa3-4740-877e-eff7c2919e69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:54.512503 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-df6b1593-6aa3-4740-877e-eff7c2919e69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:54.519141 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-df6b1593-6aa3-4740-877e-eff7c2919e69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.526798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-df6b1593-6aa3-4740-877e-eff7c2919e69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.526798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-df6b1593-6aa3-4740-877e-eff7c2919e69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.526798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-df6b1593-6aa3-4740-877e-eff7c2919e69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.658207 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-df6b1593-6aa3-4740-877e-eff7c2919e69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:54.666107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-df6b1593-6aa3-4740-877e-eff7c2919e69 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.157726 Dec 15 19:06:54.666862 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 351/684] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:54 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:54.715139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:54.715665 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:54.721646 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.722095 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.722873 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.723305 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.856054 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:54.868047 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:54.869702 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:54.870972 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-65831fe7-5707-4346-8ac5-0e3bd644776a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.160180 Dec 15 19:06:54.871797 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 352/685] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:54 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:54.878100 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d7eb6625-058d-4f98-8aec-8cd959acbbad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:54.878689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d7eb6625-058d-4f98-8aec-8cd959acbbad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:54.884511 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7eb6625-058d-4f98-8aec-8cd959acbbad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.884953 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7eb6625-058d-4f98-8aec-8cd959acbbad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:54.885986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7eb6625-058d-4f98-8aec-8cd959acbbad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:54.886415 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7eb6625-058d-4f98-8aec-8cd959acbbad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.038156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d7eb6625-058d-4f98-8aec-8cd959acbbad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:55.048130 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d7eb6625-058d-4f98-8aec-8cd959acbbad tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.173679 Dec 15 19:06:55.048850 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 353/686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:54 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:55.052964 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a3bcbf32-0309-409a-aa06-df2e79e50a2b tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:55.053584 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a3bcbf32-0309-409a-aa06-df2e79e50a2b tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:55.060523 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3bcbf32-0309-409a-aa06-df2e79e50a2b tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.060965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3bcbf32-0309-409a-aa06-df2e79e50a2b tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.061774 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3bcbf32-0309-409a-aa06-df2e79e50a2b tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.062202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3bcbf32-0309-409a-aa06-df2e79e50a2b tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.195117 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a3bcbf32-0309-409a-aa06-df2e79e50a2b tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:55.202330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a3bcbf32-0309-409a-aa06-df2e79e50a2b tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.152647 Dec 15 19:06:55.203102 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 354/687] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:55 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:55.279414 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-412da58b-6e8a-4aa1-a101-d643ddc41763 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:55.280111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-412da58b-6e8a-4aa1-a101-d643ddc41763 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:55.286585 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-412da58b-6e8a-4aa1-a101-d643ddc41763 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.287031 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-412da58b-6e8a-4aa1-a101-d643ddc41763 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.287925 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-412da58b-6e8a-4aa1-a101-d643ddc41763 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.288232 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-412da58b-6e8a-4aa1-a101-d643ddc41763 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.428113 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-412da58b-6e8a-4aa1-a101-d643ddc41763 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:55.435377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-412da58b-6e8a-4aa1-a101-d643ddc41763 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.159589 Dec 15 19:06:55.435981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 355/688] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:55 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:55.518804 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a14ce269-7675-4da4-aa2f-2117d7bcd6b6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:55.519330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a14ce269-7675-4da4-aa2f-2117d7bcd6b6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:55.525484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a14ce269-7675-4da4-aa2f-2117d7bcd6b6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.525930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a14ce269-7675-4da4-aa2f-2117d7bcd6b6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.526891 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a14ce269-7675-4da4-aa2f-2117d7bcd6b6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.527321 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a14ce269-7675-4da4-aa2f-2117d7bcd6b6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.672158 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a14ce269-7675-4da4-aa2f-2117d7bcd6b6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:55.680963 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a14ce269-7675-4da4-aa2f-2117d7bcd6b6 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.166651 Dec 15 19:06:55.681754 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 356/689] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:55 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:55.685880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fdcc0d2f-dd78-4781-9285-64197cfe1d47 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:55.686484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fdcc0d2f-dd78-4781-9285-64197cfe1d47 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:55.693861 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fdcc0d2f-dd78-4781-9285-64197cfe1d47 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.694170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fdcc0d2f-dd78-4781-9285-64197cfe1d47 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.694907 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fdcc0d2f-dd78-4781-9285-64197cfe1d47 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.695355 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fdcc0d2f-dd78-4781-9285-64197cfe1d47 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.832263 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fdcc0d2f-dd78-4781-9285-64197cfe1d47 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:55.840550 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fdcc0d2f-dd78-4781-9285-64197cfe1d47 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.157969 Dec 15 19:06:55.841145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 357/690] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:55 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:55.890092 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:55.890696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:55.896885 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.897359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:55.898204 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:55.898629 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.035919 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:56.044353 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:56.045887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:56.047030 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-37e3e168-7b02-4f8c-972d-821423e05efc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.160724 Dec 15 19:06:56.047772 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 358/691] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:55 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:56.065975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e7a03a36-b2f3-4366-9d36-14e9a138d993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:56.066585 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e7a03a36-b2f3-4366-9d36-14e9a138d993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:56.072592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e7a03a36-b2f3-4366-9d36-14e9a138d993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.073039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e7a03a36-b2f3-4366-9d36-14e9a138d993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.073860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e7a03a36-b2f3-4366-9d36-14e9a138d993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.074295 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e7a03a36-b2f3-4366-9d36-14e9a138d993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.213195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e7a03a36-b2f3-4366-9d36-14e9a138d993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:56.221592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e7a03a36-b2f3-4366-9d36-14e9a138d993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.159481 Dec 15 19:06:56.231340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 359/692] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:56 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:56.231340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a0d466f5-2a5b-4c27-b7e1-b9fe1ac94d17 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:56.231340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a0d466f5-2a5b-4c27-b7e1-b9fe1ac94d17 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:56.233545 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a0d466f5-2a5b-4c27-b7e1-b9fe1ac94d17 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.233994 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a0d466f5-2a5b-4c27-b7e1-b9fe1ac94d17 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.234785 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a0d466f5-2a5b-4c27-b7e1-b9fe1ac94d17 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.235747 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a0d466f5-2a5b-4c27-b7e1-b9fe1ac94d17 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.370909 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a0d466f5-2a5b-4c27-b7e1-b9fe1ac94d17 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:56.379314 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a0d466f5-2a5b-4c27-b7e1-b9fe1ac94d17 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.155942 Dec 15 19:06:56.379885 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 360/693] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:56 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:56.453309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ced618ff-ecb9-4cc2-ab33-06a9a6c9b091 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:56.453968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ced618ff-ecb9-4cc2-ab33-06a9a6c9b091 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:56.459773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ced618ff-ecb9-4cc2-ab33-06a9a6c9b091 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.460215 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ced618ff-ecb9-4cc2-ab33-06a9a6c9b091 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.461002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ced618ff-ecb9-4cc2-ab33-06a9a6c9b091 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.461438 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ced618ff-ecb9-4cc2-ab33-06a9a6c9b091 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.595539 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ced618ff-ecb9-4cc2-ab33-06a9a6c9b091 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:56.603125 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ced618ff-ecb9-4cc2-ab33-06a9a6c9b091 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.153449 Dec 15 19:06:56.603801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 361/694] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:56 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:56.698356 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fab29c3a-b5b9-4269-90fe-f0f91b1659fb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:56.699204 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fab29c3a-b5b9-4269-90fe-f0f91b1659fb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:56.705792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fab29c3a-b5b9-4269-90fe-f0f91b1659fb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.706251 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fab29c3a-b5b9-4269-90fe-f0f91b1659fb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.707043 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fab29c3a-b5b9-4269-90fe-f0f91b1659fb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.707499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fab29c3a-b5b9-4269-90fe-f0f91b1659fb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.848124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fab29c3a-b5b9-4269-90fe-f0f91b1659fb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:56.859933 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fab29c3a-b5b9-4269-90fe-f0f91b1659fb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.164948 Dec 15 19:06:56.863423 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 362/695] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:56 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:56.875256 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e83e5c6e-6493-4cbf-b741-c1d5260e757d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:56.876360 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e83e5c6e-6493-4cbf-b741-c1d5260e757d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:56.883117 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e83e5c6e-6493-4cbf-b741-c1d5260e757d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.883570 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e83e5c6e-6493-4cbf-b741-c1d5260e757d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:56.884359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e83e5c6e-6493-4cbf-b741-c1d5260e757d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:56.884844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e83e5c6e-6493-4cbf-b741-c1d5260e757d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.019529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e83e5c6e-6493-4cbf-b741-c1d5260e757d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:57.027952 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e83e5c6e-6493-4cbf-b741-c1d5260e757d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.163177 Dec 15 19:06:57.028547 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 363/696] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:56 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:57.067046 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:57.067975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:57.073805 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.074278 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.075214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.075650 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.208275 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:57.216688 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:57.219973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:57.219973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c65d3c56-4057-44f3-b163-9c052297a6f3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.157624 Dec 15 19:06:57.223913 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 364/697] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:57 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:57.239465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6f9481fb-a496-46a7-b745-abd73db57192 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:57.240075 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6f9481fb-a496-46a7-b745-abd73db57192 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:57.246103 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6f9481fb-a496-46a7-b745-abd73db57192 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.246556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6f9481fb-a496-46a7-b745-abd73db57192 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.247349 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6f9481fb-a496-46a7-b745-abd73db57192 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.247792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6f9481fb-a496-46a7-b745-abd73db57192 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.392910 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6f9481fb-a496-46a7-b745-abd73db57192 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:57.400396 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6f9481fb-a496-46a7-b745-abd73db57192 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.165292 Dec 15 19:06:57.400978 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 365/698] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:57 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:57.421219 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-78befa82-530c-4317-96b1-7b54577cfc56 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:57.421219 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-78befa82-530c-4317-96b1-7b54577cfc56 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:57.421219 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78befa82-530c-4317-96b1-7b54577cfc56 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.421219 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78befa82-530c-4317-96b1-7b54577cfc56 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.421913 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78befa82-530c-4317-96b1-7b54577cfc56 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.421913 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78befa82-530c-4317-96b1-7b54577cfc56 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.548429 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-78befa82-530c-4317-96b1-7b54577cfc56 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:57.555760 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-78befa82-530c-4317-96b1-7b54577cfc56 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.153804 Dec 15 19:06:57.556331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 366/699] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:57 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:57.621423 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d9e3dc5d-4c0b-4f15-9666-8c7c1fc10f6e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:57.622041 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d9e3dc5d-4c0b-4f15-9666-8c7c1fc10f6e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:57.628627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9e3dc5d-4c0b-4f15-9666-8c7c1fc10f6e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.629104 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9e3dc5d-4c0b-4f15-9666-8c7c1fc10f6e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.639529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9e3dc5d-4c0b-4f15-9666-8c7c1fc10f6e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.639529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9e3dc5d-4c0b-4f15-9666-8c7c1fc10f6e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.768446 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d9e3dc5d-4c0b-4f15-9666-8c7c1fc10f6e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:57.776673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d9e3dc5d-4c0b-4f15-9666-8c7c1fc10f6e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.159008 Dec 15 19:06:57.777429 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 367/700] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:57 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:57.878902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2fd882a3-6f3a-4ea9-9ab0-c5a56b582181 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:57.879510 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2fd882a3-6f3a-4ea9-9ab0-c5a56b582181 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:57.885465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2fd882a3-6f3a-4ea9-9ab0-c5a56b582181 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.886200 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2fd882a3-6f3a-4ea9-9ab0-c5a56b582181 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:57.886979 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2fd882a3-6f3a-4ea9-9ab0-c5a56b582181 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:57.887413 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2fd882a3-6f3a-4ea9-9ab0-c5a56b582181 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.016945 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2fd882a3-6f3a-4ea9-9ab0-c5a56b582181 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:58.024467 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2fd882a3-6f3a-4ea9-9ab0-c5a56b582181 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.149782 Dec 15 19:06:58.025039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 368/701] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:57 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:58.046765 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d86c697c-9f57-4ba4-ae41-20f585e5364d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:58.047362 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d86c697c-9f57-4ba4-ae41-20f585e5364d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:58.052826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d86c697c-9f57-4ba4-ae41-20f585e5364d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.053309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d86c697c-9f57-4ba4-ae41-20f585e5364d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.054080 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d86c697c-9f57-4ba4-ae41-20f585e5364d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.054516 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d86c697c-9f57-4ba4-ae41-20f585e5364d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.179975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d86c697c-9f57-4ba4-ae41-20f585e5364d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:58.187803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d86c697c-9f57-4ba4-ae41-20f585e5364d tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.144255 Dec 15 19:06:58.189207 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 369/702] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:58 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:58.238384 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:58.239104 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:58.244867 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.245358 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.246150 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.247832 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.272005 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-52eb42f3-15b7-49a7-a73e-3d04b25c1958 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 35009 microversion: 2.1 time: 13.333374 Dec 15 19:06:58.272710 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 334/703] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:44 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 35009 bytes in 13335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:06:58.419066 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fa01ea68-1ce8-4019-93b1-4e35adba20af tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:58.419866 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fa01ea68-1ce8-4019-93b1-4e35adba20af tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:58.427150 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fa01ea68-1ce8-4019-93b1-4e35adba20af tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.427616 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fa01ea68-1ce8-4019-93b1-4e35adba20af tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.428435 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fa01ea68-1ce8-4019-93b1-4e35adba20af tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.428877 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fa01ea68-1ce8-4019-93b1-4e35adba20af tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.530893 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:58.540550 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:58.542992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:58.543242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d516cf88-a56a-4de4-8584-d6e9412e1e8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.309022 Dec 15 19:06:58.548297 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 370/704] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:58 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:06:58.572732 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5802d433-b293-4d83-a6cb-7aa179049074 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:58.573495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5802d433-b293-4d83-a6cb-7aa179049074 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:58.582573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5802d433-b293-4d83-a6cb-7aa179049074 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.585011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5802d433-b293-4d83-a6cb-7aa179049074 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.585011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5802d433-b293-4d83-a6cb-7aa179049074 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.585011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5802d433-b293-4d83-a6cb-7aa179049074 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.597528 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fa01ea68-1ce8-4019-93b1-4e35adba20af tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:58.607425 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fa01ea68-1ce8-4019-93b1-4e35adba20af tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1275 microversion: 2.1 time: 0.192400 Dec 15 19:06:58.617606 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 335/705] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:58 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:58.769998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5802d433-b293-4d83-a6cb-7aa179049074 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:58.777246 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5802d433-b293-4d83-a6cb-7aa179049074 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.209475 Dec 15 19:06:58.777821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 371/706] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:58 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:58.794588 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a0011e16-0b32-4644-b1f5-0836f038ce04 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:58.795192 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a0011e16-0b32-4644-b1f5-0836f038ce04 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:58.801984 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0011e16-0b32-4644-b1f5-0836f038ce04 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.802434 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0011e16-0b32-4644-b1f5-0836f038ce04 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.803216 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0011e16-0b32-4644-b1f5-0836f038ce04 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:58.803637 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0011e16-0b32-4644-b1f5-0836f038ce04 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:58.943422 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a0011e16-0b32-4644-b1f5-0836f038ce04 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:58.950980 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a0011e16-0b32-4644-b1f5-0836f038ce04 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.159951 Dec 15 19:06:58.951646 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 336/707] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:58 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:59.042063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-15759d8b-f67f-46ae-9d53-4ab3e10aff5f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:59.045353 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-15759d8b-f67f-46ae-9d53-4ab3e10aff5f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:59.049298 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-15759d8b-f67f-46ae-9d53-4ab3e10aff5f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.049757 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-15759d8b-f67f-46ae-9d53-4ab3e10aff5f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.050614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-15759d8b-f67f-46ae-9d53-4ab3e10aff5f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.051031 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-15759d8b-f67f-46ae-9d53-4ab3e10aff5f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.086254 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-1668d736-9dc0-438c-886f-a90ec89344ed req-85128a5b-130e-46ca-bc7f-e7913dff2d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688fbf24-7c98-4e51-8d6d-3a9f84044719", "tag": "3d828ab8-0ca7-48b9-813f-689cb063f4ad"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:59.088234 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:06:59.088234 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:06:59.100264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-1668d736-9dc0-438c-886f-a90ec89344ed req-85128a5b-130e-46ca-bc7f-e7913dff2d2a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.100879 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-1668d736-9dc0-438c-886f-a90ec89344ed req-85128a5b-130e-46ca-bc7f-e7913dff2d2a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.112619 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-1668d736-9dc0-438c-886f-a90ec89344ed req-85128a5b-130e-46ca-bc7f-e7913dff2d2a service nova] Creating event network-changed:3d828ab8-0ca7-48b9-813f-689cb063f4ad for instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 on hv-cinder-81268 Dec 15 19:06:59.118008 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-1668d736-9dc0-438c-886f-a90ec89344ed req-85128a5b-130e-46ca-bc7f-e7913dff2d2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035397 Dec 15 19:06:59.118610 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 337/708] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:06:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:06:59.206894 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f9816fe5-1d74-4a5e-b1e4-6d21da84084b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:59.207598 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f9816fe5-1d74-4a5e-b1e4-6d21da84084b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:59.213831 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9816fe5-1d74-4a5e-b1e4-6d21da84084b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.214439 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9816fe5-1d74-4a5e-b1e4-6d21da84084b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.215463 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9816fe5-1d74-4a5e-b1e4-6d21da84084b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.216072 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9816fe5-1d74-4a5e-b1e4-6d21da84084b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.244997 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-15759d8b-f67f-46ae-9d53-4ab3e10aff5f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:59.272097 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-15759d8b-f67f-46ae-9d53-4ab3e10aff5f tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.233682 Dec 15 19:06:59.273283 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 372/709] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:59 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:59.283914 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7d0a89a2-816e-4068-825c-b59ac550b9b1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:06:59.285268 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7d0a89a2-816e-4068-825c-b59ac550b9b1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:59.292183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d0a89a2-816e-4068-825c-b59ac550b9b1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.292895 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d0a89a2-816e-4068-825c-b59ac550b9b1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.293932 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d0a89a2-816e-4068-825c-b59ac550b9b1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.294592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d0a89a2-816e-4068-825c-b59ac550b9b1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.379739 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f9816fe5-1d74-4a5e-b1e4-6d21da84084b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:59.387500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f9816fe5-1d74-4a5e-b1e4-6d21da84084b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.185318 Dec 15 19:06:59.388256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 338/710] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:59 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:06:59.393762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7d0a89a2-816e-4068-825c-b59ac550b9b1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 35456 microversion: 2.1 time: 0.113724 Dec 15 19:06:59.394967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 373/711] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:06:59 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 35456 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:06:59.562096 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:59.563327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:59.569154 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.569619 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.570400 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.570857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.626554 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1aed0d3a-a493-4733-a8ed-fc26fa7732ca tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:59.627649 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1aed0d3a-a493-4733-a8ed-fc26fa7732ca tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:59.634806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1aed0d3a-a493-4733-a8ed-fc26fa7732ca tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.635264 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1aed0d3a-a493-4733-a8ed-fc26fa7732ca tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.636056 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1aed0d3a-a493-4733-a8ed-fc26fa7732ca tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.636561 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1aed0d3a-a493-4733-a8ed-fc26fa7732ca tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.708929 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:59.718120 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:59.719705 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:59.720881 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4307e2ee-975e-40bd-93d1-697342d45d5f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.162585 Dec 15 19:06:59.721471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 339/712] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:06:59 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:06:59.793749 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-74f48392-77f3-416c-9103-8f65b947969e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:59.794499 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-74f48392-77f3-416c-9103-8f65b947969e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:59.800421 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-74f48392-77f3-416c-9103-8f65b947969e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.800874 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-74f48392-77f3-416c-9103-8f65b947969e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.801852 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-74f48392-77f3-416c-9103-8f65b947969e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.802131 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-74f48392-77f3-416c-9103-8f65b947969e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.841186 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1aed0d3a-a493-4733-a8ed-fc26fa7732ca tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:06:59.848383 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1aed0d3a-a493-4733-a8ed-fc26fa7732ca tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.226325 Dec 15 19:06:59.848963 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 374/713] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:59 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:06:59.967458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7d5d15f2-1c09-4f65-9549-d0fba12960e4 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:06:59.968066 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7d5d15f2-1c09-4f65-9549-d0fba12960e4 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:06:59.974627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d5d15f2-1c09-4f65-9549-d0fba12960e4 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.975079 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d5d15f2-1c09-4f65-9549-d0fba12960e4 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:06:59.975874 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d5d15f2-1c09-4f65-9549-d0fba12960e4 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:06:59.976319 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d5d15f2-1c09-4f65-9549-d0fba12960e4 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.014358 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-74f48392-77f3-416c-9103-8f65b947969e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:00.022350 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-74f48392-77f3-416c-9103-8f65b947969e tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1314 microversion: 2.1 time: 0.232142 Dec 15 19:07:00.023282 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 340/714] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:59 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:00.114704 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7d5d15f2-1c09-4f65-9549-d0fba12960e4 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:00.122400 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7d5d15f2-1c09-4f65-9549-d0fba12960e4 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1514 microversion: 2.1 time: 0.158460 Dec 15 19:07:00.123011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 375/715] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:06:59 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:00.290127 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-04978acb-2ea7-4a81-ac25-ff7d0736885b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:00.290756 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-04978acb-2ea7-4a81-ac25-ff7d0736885b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:00.296622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04978acb-2ea7-4a81-ac25-ff7d0736885b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.297075 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04978acb-2ea7-4a81-ac25-ff7d0736885b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.298415 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04978acb-2ea7-4a81-ac25-ff7d0736885b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.298849 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04978acb-2ea7-4a81-ac25-ff7d0736885b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.404928 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-33d9c200-8115-40ad-9d50-509db8457cb4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:00.405564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-33d9c200-8115-40ad-9d50-509db8457cb4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:00.413291 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-33d9c200-8115-40ad-9d50-509db8457cb4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.413845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-33d9c200-8115-40ad-9d50-509db8457cb4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.414786 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-33d9c200-8115-40ad-9d50-509db8457cb4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.415293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-33d9c200-8115-40ad-9d50-509db8457cb4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.492598 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-04978acb-2ea7-4a81-ac25-ff7d0736885b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:00.503423 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-04978acb-2ea7-4a81-ac25-ff7d0736885b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.217121 Dec 15 19:07:00.504011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 341/716] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:00 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:00.509817 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d1190f2c-5964-4bb3-be5e-68d94915a1bf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:00.510910 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d1190f2c-5964-4bb3-be5e-68d94915a1bf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:00.516944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1190f2c-5964-4bb3-be5e-68d94915a1bf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.517475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1190f2c-5964-4bb3-be5e-68d94915a1bf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.518266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1190f2c-5964-4bb3-be5e-68d94915a1bf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.518722 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1190f2c-5964-4bb3-be5e-68d94915a1bf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.561402 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-33d9c200-8115-40ad-9d50-509db8457cb4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:00.569217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-33d9c200-8115-40ad-9d50-509db8457cb4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.167959 Dec 15 19:07:00.569791 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 376/717] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:00 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:00.574322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-6cbd8cf9-4ac5-4c30-af84-59a3f935433f req-5a8c7fe3-aded-40e5-b32f-0ee7303f7e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e09c87-53f0-4d48-9eba-d5adae8227e3", "name": "network-vif-deleted", "tag": "828144f6-72f4-4245-b754-2f3f975b9c13"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:00.575824 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:00.575824 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:07:00.582388 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-6cbd8cf9-4ac5-4c30-af84-59a3f935433f req-5a8c7fe3-aded-40e5-b32f-0ee7303f7e9f service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.582830 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-6cbd8cf9-4ac5-4c30-af84-59a3f935433f req-5a8c7fe3-aded-40e5-b32f-0ee7303f7e9f service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.593420 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-6cbd8cf9-4ac5-4c30-af84-59a3f935433f req-5a8c7fe3-aded-40e5-b32f-0ee7303f7e9f service nova] Creating event network-vif-deleted:828144f6-72f4-4245-b754-2f3f975b9c13 for instance 26e09c87-53f0-4d48-9eba-d5adae8227e3 on hv-cinder-81268 Dec 15 19:07:00.598961 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-6cbd8cf9-4ac5-4c30-af84-59a3f935433f req-5a8c7fe3-aded-40e5-b32f-0ee7303f7e9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027876 Dec 15 19:07:00.599525 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 377/718] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:00.739771 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:00.740387 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:00.746421 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.746871 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.747651 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.748089 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.760866 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d1190f2c-5964-4bb3-be5e-68d94915a1bf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 36292 microversion: 2.1 time: 0.255618 Dec 15 19:07:00.765395 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 342/719] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:07:00 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 36292 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:07:00.871541 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-054d5171-d3c4-48a3-82cd-584ad31fa897 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:00.872252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-054d5171-d3c4-48a3-82cd-584ad31fa897 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:00.879379 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-054d5171-d3c4-48a3-82cd-584ad31fa897 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.879835 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-054d5171-d3c4-48a3-82cd-584ad31fa897 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.880405 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:00.880622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-054d5171-d3c4-48a3-82cd-584ad31fa897 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:00.881061 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-054d5171-d3c4-48a3-82cd-584ad31fa897 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:00.888865 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:00.890414 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:00.892053 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c77eec2c-6c7a-4298-a037-9e6b4d713a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.156497 Dec 15 19:07:00.892613 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 378/720] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:00 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:07:01.025494 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-054d5171-d3c4-48a3-82cd-584ad31fa897 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:01.033474 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-054d5171-d3c4-48a3-82cd-584ad31fa897 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.166110 Dec 15 19:07:01.034242 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 343/721] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:00 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:01.039199 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-13a2aabd-cbe2-43e4-8e95-26966ebd2877 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:01.039809 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-13a2aabd-cbe2-43e4-8e95-26966ebd2877 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:01.046080 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-13a2aabd-cbe2-43e4-8e95-26966ebd2877 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.046530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-13a2aabd-cbe2-43e4-8e95-26966ebd2877 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.047311 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-13a2aabd-cbe2-43e4-8e95-26966ebd2877 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.047742 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-13a2aabd-cbe2-43e4-8e95-26966ebd2877 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.140461 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:01.141754 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:01.148106 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.148634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.149550 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.150063 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.181755 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.182252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.182699 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lazy-loading 'fault' on Instance uuid 26e09c87-53f0-4d48-9eba-d5adae8227e3 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:01.202440 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-13a2aabd-cbe2-43e4-8e95-26966ebd2877 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:01.210634 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-13a2aabd-cbe2-43e4-8e95-26966ebd2877 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1463 microversion: 2.1 time: 0.175052 Dec 15 19:07:01.211526 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 379/722] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:01 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1463 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:01.221726 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:01.229660 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ae94c754-4b92-4cf7-83b9-33ee585750af tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 200 len: 1309 microversion: 2.1 time: 0.093227 Dec 15 19:07:01.230421 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 344/723] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:01 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:01.255118 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d0e6ed1b-7712-460a-a467-ff551d3a0901 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:01.255609 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d0e6ed1b-7712-460a-a467-ff551d3a0901 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:01.261416 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d0e6ed1b-7712-460a-a467-ff551d3a0901 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.261859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d0e6ed1b-7712-460a-a467-ff551d3a0901 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.262637 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d0e6ed1b-7712-460a-a467-ff551d3a0901 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.263122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d0e6ed1b-7712-460a-a467-ff551d3a0901 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.287888 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d0e6ed1b-7712-460a-a467-ff551d3a0901 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:07:01.519810 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8ca52c1c-992a-4875-bd7e-b1a2586464d5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:01.520423 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8ca52c1c-992a-4875-bd7e-b1a2586464d5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:01.527002 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8ca52c1c-992a-4875-bd7e-b1a2586464d5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.527453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8ca52c1c-992a-4875-bd7e-b1a2586464d5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.528256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8ca52c1c-992a-4875-bd7e-b1a2586464d5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.528692 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8ca52c1c-992a-4875-bd7e-b1a2586464d5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.549156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d0e6ed1b-7712-460a-a467-ff551d3a0901 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "DELETE /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 204 len: 0 microversion: 2.1 time: 0.296980 Dec 15 19:07:01.550911 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 380/724] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:07:01 2021] DELETE /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:07:01.558332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-121c4ae2-456f-4ac3-84fb-1cdce0ac3d11 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:01.561549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-121c4ae2-456f-4ac3-84fb-1cdce0ac3d11 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:01.567334 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-121c4ae2-456f-4ac3-84fb-1cdce0ac3d11 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.568052 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-121c4ae2-456f-4ac3-84fb-1cdce0ac3d11 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.568905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-121c4ae2-456f-4ac3-84fb-1cdce0ac3d11 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.569463 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-121c4ae2-456f-4ac3-84fb-1cdce0ac3d11 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.689476 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8ca52c1c-992a-4875-bd7e-b1a2586464d5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:01.696886 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8ca52c1c-992a-4875-bd7e-b1a2586464d5 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1514 microversion: 2.1 time: 0.180786 Dec 15 19:07:01.697478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 345/725] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:01 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:01.701924 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e43d46c1-bf2b-4ae3-9855-a79241f088dc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:01.702673 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e43d46c1-bf2b-4ae3-9855-a79241f088dc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:01.712448 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e43d46c1-bf2b-4ae3-9855-a79241f088dc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.712905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e43d46c1-bf2b-4ae3-9855-a79241f088dc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.713756 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e43d46c1-bf2b-4ae3-9855-a79241f088dc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.714199 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e43d46c1-bf2b-4ae3-9855-a79241f088dc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.837746 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-121c4ae2-456f-4ac3-84fb-1cdce0ac3d11 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:01.846294 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-121c4ae2-456f-4ac3-84fb-1cdce0ac3d11 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1469 microversion: 2.1 time: 0.291787 Dec 15 19:07:01.846969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 381/726] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:01 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1469 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:01.851862 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-cc30dd7b-9589-4307-85e1-4be0c83f356d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:01.852836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-cc30dd7b-9589-4307-85e1-4be0c83f356d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:01.862778 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cc30dd7b-9589-4307-85e1-4be0c83f356d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.863232 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cc30dd7b-9589-4307-85e1-4be0c83f356d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.864815 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cc30dd7b-9589-4307-85e1-4be0c83f356d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.864949 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e43d46c1-bf2b-4ae3-9855-a79241f088dc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:01.865290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cc30dd7b-9589-4307-85e1-4be0c83f356d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.873567 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e43d46c1-bf2b-4ae3-9855-a79241f088dc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1567 microversion: 2.1 time: 0.174924 Dec 15 19:07:01.874351 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 346/727] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:01 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:01.911145 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:01.911743 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:01.917587 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.918028 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.918800 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:01.919229 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:01.944065 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-cc30dd7b-9589-4307-85e1-4be0c83f356d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 37097 microversion: 2.1 time: 0.095434 Dec 15 19:07:01.945412 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 382/728] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:07:01 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 37097 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:07:02.051202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a3d5768d-48dd-429c-969e-7ea635bddbf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:02.051905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a3d5768d-48dd-429c-969e-7ea635bddbf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:02.058584 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3d5768d-48dd-429c-969e-7ea635bddbf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.059038 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3d5768d-48dd-429c-969e-7ea635bddbf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.059830 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3d5768d-48dd-429c-969e-7ea635bddbf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.060132 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:02.060288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3d5768d-48dd-429c-969e-7ea635bddbf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.068667 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:02.070203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:02.071365 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b1715dee-22bf-46be-b711-bcfe9acd2abf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.164556 Dec 15 19:07:02.082333 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 347/729] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:01 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:07:02.135113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-4ab6fa06-a54e-46e1-9c24-b9860d7bb8e8 req-e0d2384f-0fc9-4ecf-9f7f-a9694dbbd716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75af622f-27d3-45a3-8cd5-c58be636bf58", "name": "network-vif-deleted", "tag": "ccb93599-d69e-4dee-a1b0-4b565ff2cdda"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:02.136954 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:02.136954 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:07:02.144650 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-4ab6fa06-a54e-46e1-9c24-b9860d7bb8e8 req-e0d2384f-0fc9-4ecf-9f7f-a9694dbbd716 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.145252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-4ab6fa06-a54e-46e1-9c24-b9860d7bb8e8 req-e0d2384f-0fc9-4ecf-9f7f-a9694dbbd716 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.157337 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-4ab6fa06-a54e-46e1-9c24-b9860d7bb8e8 req-e0d2384f-0fc9-4ecf-9f7f-a9694dbbd716 service nova] Creating event network-vif-deleted:ccb93599-d69e-4dee-a1b0-4b565ff2cdda for instance 75af622f-27d3-45a3-8cd5-c58be636bf58 on hv-cinder-81268 Dec 15 19:07:02.162622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-4ab6fa06-a54e-46e1-9c24-b9860d7bb8e8 req-e0d2384f-0fc9-4ecf-9f7f-a9694dbbd716 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032938 Dec 15 19:07:02.163697 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 348/730] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:02.226751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a3d5768d-48dd-429c-969e-7ea635bddbf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:02.234789 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a3d5768d-48dd-429c-969e-7ea635bddbf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.188614 Dec 15 19:07:02.241266 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 383/731] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:02 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:02.246909 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d54ddf3c-938b-4d5a-ad8f-9fbbb6e154d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:02.251770 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d54ddf3c-938b-4d5a-ad8f-9fbbb6e154d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: 26e09c87-53f0-4d48-9eba-d5adae8227e3] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:02.254299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d54ddf3c-938b-4d5a-ad8f-9fbbb6e154d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.254748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d54ddf3c-938b-4d5a-ad8f-9fbbb6e154d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.255563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d54ddf3c-938b-4d5a-ad8f-9fbbb6e154d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.255990 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d54ddf3c-938b-4d5a-ad8f-9fbbb6e154d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.270088 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-d54ddf3c-938b-4d5a-ad8f-9fbbb6e154d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] HTTP exception thrown: Instance 26e09c87-53f0-4d48-9eba-d5adae8227e3 could not be found. Dec 15 19:07:02.270683 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d54ddf3c-938b-4d5a-ad8f-9fbbb6e154d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Returning 404 to user: Instance 26e09c87-53f0-4d48-9eba-d5adae8227e3 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:02.271510 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d54ddf3c-938b-4d5a-ad8f-9fbbb6e154d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3" status: 404 len: 111 microversion: 2.1 time: 0.028659 Dec 15 19:07:02.272055 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 349/732] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:02 2021] GET /compute/v2.1/servers/26e09c87-53f0-4d48-9eba-d5adae8227e3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:07:02.714088 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:02.714609 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:02.720921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.721393 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.722243 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.722750 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.753472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.753920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.754370 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lazy-loading 'fault' on Instance uuid 75af622f-27d3-45a3-8cd5-c58be636bf58 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:02.795695 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:02.802939 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-01f02e99-7f77-4129-a93c-75bcc4231dd9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1308 microversion: 2.1 time: 0.092683 Dec 15 19:07:02.803502 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 384/733] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:02 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:02.863392 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f3e3b5a0-b42c-43ae-a6b6-08a9641c942a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:02.863993 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f3e3b5a0-b42c-43ae-a6b6-08a9641c942a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:02.869748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3e3b5a0-b42c-43ae-a6b6-08a9641c942a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.870196 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3e3b5a0-b42c-43ae-a6b6-08a9641c942a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.870974 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3e3b5a0-b42c-43ae-a6b6-08a9641c942a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.871406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f3e3b5a0-b42c-43ae-a6b6-08a9641c942a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.890676 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ef323c56-0ff2-4c3d-a8a3-d0f4d48d5079 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:02.891932 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ef323c56-0ff2-4c3d-a8a3-d0f4d48d5079 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:02.897659 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef323c56-0ff2-4c3d-a8a3-d0f4d48d5079 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.898106 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef323c56-0ff2-4c3d-a8a3-d0f4d48d5079 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:02.898876 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef323c56-0ff2-4c3d-a8a3-d0f4d48d5079 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:02.899303 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef323c56-0ff2-4c3d-a8a3-d0f4d48d5079 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.005044 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f3e3b5a0-b42c-43ae-a6b6-08a9641c942a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:03.012337 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f3e3b5a0-b42c-43ae-a6b6-08a9641c942a tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1469 microversion: 2.1 time: 0.152564 Dec 15 19:07:03.012922 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 350/734] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:02 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:03.017209 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-732d1522-8374-47e4-9d9a-b9fffd3066f0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:03.018168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-732d1522-8374-47e4-9d9a-b9fffd3066f0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:03.026370 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-732d1522-8374-47e4-9d9a-b9fffd3066f0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.026818 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-732d1522-8374-47e4-9d9a-b9fffd3066f0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.027611 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-732d1522-8374-47e4-9d9a-b9fffd3066f0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.028051 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-732d1522-8374-47e4-9d9a-b9fffd3066f0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.037610 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ef323c56-0ff2-4c3d-a8a3-d0f4d48d5079 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:03.045728 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ef323c56-0ff2-4c3d-a8a3-d0f4d48d5079 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1547 microversion: 2.1 time: 0.158575 Dec 15 19:07:03.046295 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 385/735] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:02 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:03.062210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-974194c0-6f08-406b-9efa-1238efbdcc89 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:03.063356 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-974194c0-6f08-406b-9efa-1238efbdcc89 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:03.069025 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-974194c0-6f08-406b-9efa-1238efbdcc89 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.069509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-974194c0-6f08-406b-9efa-1238efbdcc89 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.070346 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-974194c0-6f08-406b-9efa-1238efbdcc89 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.070780 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-974194c0-6f08-406b-9efa-1238efbdcc89 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.147432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-974194c0-6f08-406b-9efa-1238efbdcc89 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] HTTP exception thrown: Cannot 'detach_volume' instance 93f130e2-e041-400a-934f-9c837ba505ef while it is in vm_state rescued Dec 15 19:07:03.148031 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-974194c0-6f08-406b-9efa-1238efbdcc89 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Returning 409 to user: Cannot 'detach_volume' instance 93f130e2-e041-400a-934f-9c837ba505ef while it is in vm_state rescued {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:03.148859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-974194c0-6f08-406b-9efa-1238efbdcc89 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "DELETE /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments/1f716fec-ed87-47fe-8800-55099d62e383" status: 409 len: 152 microversion: 2.1 time: 0.090334 Dec 15 19:07:03.149452 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 386/736] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:07:03 2021] DELETE /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments/1f716fec-ed87-47fe-8800-55099d62e383 => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 15 19:07:03.153877 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:03.154476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:03.159785 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.160235 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.161033 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.161499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.289001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:03.297828 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:03.299327 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:03.300460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-00abad0c-f1d6-4796-9f70-eeba18e2386a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.150063 Dec 15 19:07:03.301013 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 387/737] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:03 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:03.313934 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-909f00f2-8cab-4d69-b48d-419c9ca2204b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:03.314466 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-909f00f2-8cab-4d69-b48d-419c9ca2204b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:03.320428 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-909f00f2-8cab-4d69-b48d-419c9ca2204b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.320875 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-909f00f2-8cab-4d69-b48d-419c9ca2204b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.321697 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-909f00f2-8cab-4d69-b48d-419c9ca2204b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.322128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-909f00f2-8cab-4d69-b48d-419c9ca2204b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.510239 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-909f00f2-8cab-4d69-b48d-419c9ca2204b tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/action" status: 202 len: 0 microversion: 2.1 time: 0.207969 Dec 15 19:07:03.514083 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 388/738] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:07:03 2021] POST /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:07:03.515728 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a44eeb1a-32f4-4d9a-b22d-5a78eac2399f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:03.516419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a44eeb1a-32f4-4d9a-b22d-5a78eac2399f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:03.522410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a44eeb1a-32f4-4d9a-b22d-5a78eac2399f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.522862 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a44eeb1a-32f4-4d9a-b22d-5a78eac2399f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.523639 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a44eeb1a-32f4-4d9a-b22d-5a78eac2399f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.524071 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a44eeb1a-32f4-4d9a-b22d-5a78eac2399f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.653430 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a44eeb1a-32f4-4d9a-b22d-5a78eac2399f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:03.661149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a44eeb1a-32f4-4d9a-b22d-5a78eac2399f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.149217 Dec 15 19:07:03.661710 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 389/739] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:03 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:03.665824 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-856f5a3c-a9ea-42e5-b5a2-9116f0a7112c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:03.666419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-856f5a3c-a9ea-42e5-b5a2-9116f0a7112c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:03.671833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-856f5a3c-a9ea-42e5-b5a2-9116f0a7112c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.672829 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-856f5a3c-a9ea-42e5-b5a2-9116f0a7112c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.673634 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-856f5a3c-a9ea-42e5-b5a2-9116f0a7112c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.674068 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-856f5a3c-a9ea-42e5-b5a2-9116f0a7112c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.805348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-856f5a3c-a9ea-42e5-b5a2-9116f0a7112c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:03.812921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-856f5a3c-a9ea-42e5-b5a2-9116f0a7112c tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1555 microversion: 2.1 time: 0.150272 Dec 15 19:07:03.813506 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 390/740] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:03 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:03.820835 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:03.821487 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:03.827066 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.827546 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.828834 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.829293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.858665 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:03.859116 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:03.859559 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lazy-loading 'fault' on Instance uuid 75af622f-27d3-45a3-8cd5-c58be636bf58 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:03.896878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:03.903862 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3e6c5c66-01e8-4f71-b29d-ea9a148c3dd2 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1308 microversion: 2.1 time: 0.086417 Dec 15 19:07:03.904427 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 391/741] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:03 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1308 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:04.027997 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-93637c3f-b11b-407b-858a-41225bfd5058 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:04.028595 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-93637c3f-b11b-407b-858a-41225bfd5058 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:04.035076 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-93637c3f-b11b-407b-858a-41225bfd5058 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.035516 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-93637c3f-b11b-407b-858a-41225bfd5058 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:04.036566 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-93637c3f-b11b-407b-858a-41225bfd5058 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.036997 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-93637c3f-b11b-407b-858a-41225bfd5058 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:04.162671 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-93637c3f-b11b-407b-858a-41225bfd5058 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:04.169756 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-93637c3f-b11b-407b-858a-41225bfd5058 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1469 microversion: 2.1 time: 0.145283 Dec 15 19:07:04.170311 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 392/742] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:04 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1469 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:04.318844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:04.319441 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:04.325452 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.325901 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:04.326667 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.327098 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:04.461807 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:04.469946 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:04.471453 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:04.472598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6545e1aa-c11c-42e9-a14a-d8dbfd225427 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.157578 Dec 15 19:07:04.473170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 393/743] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:04 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:07:04.678288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b60ec014-b127-48ff-8dee-9ddb1c369692 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:04.678817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b60ec014-b127-48ff-8dee-9ddb1c369692 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:04.685033 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b60ec014-b127-48ff-8dee-9ddb1c369692 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.685652 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b60ec014-b127-48ff-8dee-9ddb1c369692 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:04.686431 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b60ec014-b127-48ff-8dee-9ddb1c369692 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.686868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b60ec014-b127-48ff-8dee-9ddb1c369692 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:04.817642 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b60ec014-b127-48ff-8dee-9ddb1c369692 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:04.824860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b60ec014-b127-48ff-8dee-9ddb1c369692 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.150155 Dec 15 19:07:04.825457 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 394/744] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:04 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:04.829689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-de672208-2f9e-4b8d-b5d0-4d495d7aad4e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:04.830301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-de672208-2f9e-4b8d-b5d0-4d495d7aad4e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:04.835866 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de672208-2f9e-4b8d-b5d0-4d495d7aad4e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.836342 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de672208-2f9e-4b8d-b5d0-4d495d7aad4e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:04.837134 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de672208-2f9e-4b8d-b5d0-4d495d7aad4e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.837568 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de672208-2f9e-4b8d-b5d0-4d495d7aad4e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:04.965603 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-de672208-2f9e-4b8d-b5d0-4d495d7aad4e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:04.973660 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-de672208-2f9e-4b8d-b5d0-4d495d7aad4e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1555 microversion: 2.1 time: 0.147232 Dec 15 19:07:04.974218 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 395/745] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:04 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:04.978277 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:04.978863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:04.984084 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.985160 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:04.985928 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:04.986355 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:05.014745 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:05.015180 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:05.015614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lazy-loading 'fault' on Instance uuid 75af622f-27d3-45a3-8cd5-c58be636bf58 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:05.053335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:05.060885 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-64941e39-9416-4187-85ff-b9161880f04d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 200 len: 1308 microversion: 2.1 time: 0.085645 Dec 15 19:07:05.061499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 396/746] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:04 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 1308 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:05.186407 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5ef0a3c5-cc55-40c6-b817-fc5ffe7b62d1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:05.187014 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5ef0a3c5-cc55-40c6-b817-fc5ffe7b62d1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:05.192883 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5ef0a3c5-cc55-40c6-b817-fc5ffe7b62d1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:05.193444 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5ef0a3c5-cc55-40c6-b817-fc5ffe7b62d1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:05.194153 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5ef0a3c5-cc55-40c6-b817-fc5ffe7b62d1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:05.194577 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5ef0a3c5-cc55-40c6-b817-fc5ffe7b62d1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:05.319868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5ef0a3c5-cc55-40c6-b817-fc5ffe7b62d1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:05.326973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5ef0a3c5-cc55-40c6-b817-fc5ffe7b62d1 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1469 microversion: 2.1 time: 0.144156 Dec 15 19:07:05.327530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 397/747] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:05 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1469 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:05.490712 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:05.491316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:05.497202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:05.497646 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:05.498416 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:05.498836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:05.629426 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:05.637566 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:05.639054 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:05.640193 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c773d49d-fabb-419c-be5b-debad61a9070 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.153327 Dec 15 19:07:05.644844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 398/748] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:05 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:05.841536 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8453605a-e044-48af-bc3e-bb151be6671a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:05.842107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8453605a-e044-48af-bc3e-bb151be6671a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:05.848358 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8453605a-e044-48af-bc3e-bb151be6671a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:05.848803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8453605a-e044-48af-bc3e-bb151be6671a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:05.849606 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8453605a-e044-48af-bc3e-bb151be6671a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:05.850035 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8453605a-e044-48af-bc3e-bb151be6671a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:05.933734 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-732d1522-8374-47e4-9d9a-b9fffd3066f0 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 38217 microversion: 2.1 time: 2.919304 Dec 15 19:07:05.939043 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 351/749] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:07:03 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 38217 bytes in 2921 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:07:05.986253 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8453605a-e044-48af-bc3e-bb151be6671a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:05.993755 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8453605a-e044-48af-bc3e-bb151be6671a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.155792 Dec 15 19:07:05.994197 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2d61b73c-4c9a-46e5-8a6a-c97b4881df37 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:06.004360 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 399/750] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:05 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:06.004560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2d61b73c-4c9a-46e5-8a6a-c97b4881df37 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:06.004560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2d61b73c-4c9a-46e5-8a6a-c97b4881df37 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.004560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2d61b73c-4c9a-46e5-8a6a-c97b4881df37 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.004794 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2d61b73c-4c9a-46e5-8a6a-c97b4881df37 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.005248 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2d61b73c-4c9a-46e5-8a6a-c97b4881df37 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.081853 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fdb1f3cb-b18c-414b-93af-9afd5aeb410d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:06.082744 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fdb1f3cb-b18c-414b-93af-9afd5aeb410d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 75af622f-27d3-45a3-8cd5-c58be636bf58] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:06.089209 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fdb1f3cb-b18c-414b-93af-9afd5aeb410d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.091962 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fdb1f3cb-b18c-414b-93af-9afd5aeb410d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.091962 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fdb1f3cb-b18c-414b-93af-9afd5aeb410d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.091962 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fdb1f3cb-b18c-414b-93af-9afd5aeb410d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.106153 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-fdb1f3cb-b18c-414b-93af-9afd5aeb410d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] HTTP exception thrown: Instance 75af622f-27d3-45a3-8cd5-c58be636bf58 could not be found. Dec 15 19:07:06.106922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fdb1f3cb-b18c-414b-93af-9afd5aeb410d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Returning 404 to user: Instance 75af622f-27d3-45a3-8cd5-c58be636bf58 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:06.107758 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fdb1f3cb-b18c-414b-93af-9afd5aeb410d tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58" status: 404 len: 111 microversion: 2.1 time: 0.030504 Dec 15 19:07:06.108320 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 400/751] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:06 2021] GET /compute/v2.1/servers/75af622f-27d3-45a3-8cd5-c58be636bf58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:07:06.155488 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-2d61b73c-4c9a-46e5-8a6a-c97b4881df37 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:06.163418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2d61b73c-4c9a-46e5-8a6a-c97b4881df37 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1555 microversion: 2.1 time: 0.175629 Dec 15 19:07:06.163977 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 352/752] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:05 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:06.349193 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-236b052d-4415-4b9c-be65-38a0c52908ef tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:06.349193 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-236b052d-4415-4b9c-be65-38a0c52908ef tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:06.351413 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-236b052d-4415-4b9c-be65-38a0c52908ef tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.351966 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-236b052d-4415-4b9c-be65-38a0c52908ef tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.352850 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-236b052d-4415-4b9c-be65-38a0c52908ef tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.353402 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-236b052d-4415-4b9c-be65-38a0c52908ef tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.564941 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-236b052d-4415-4b9c-be65-38a0c52908ef tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:06.573826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-236b052d-4415-4b9c-be65-38a0c52908ef tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1469 microversion: 2.1 time: 0.233182 Dec 15 19:07:06.573826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 401/753] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:06 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:06.659290 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:06.659811 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:06.666005 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.666461 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.667249 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.667691 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.858257 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:06.871494 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:06.873037 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:06.874463 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d15e9fa3-df52-417b-b4ef-265cb7ac16d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.219340 Dec 15 19:07:06.876675 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 353/754] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:06 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:06.899585 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-dc065573-ec5e-4384-b138-c8c1cc09d0ad req-932519f3-edc4-4c4d-bd4b-c89a4020d116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848dbdaf-18c0-4beb-a74b-5b6d09d5911f", "name": "network-vif-deleted", "tag": "6ebe1443-a187-419b-b3fd-548c8b30dbb0"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:06.901374 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:06.901374 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:07:06.909580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-dc065573-ec5e-4384-b138-c8c1cc09d0ad req-932519f3-edc4-4c4d-bd4b-c89a4020d116 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.910003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-dc065573-ec5e-4384-b138-c8c1cc09d0ad req-932519f3-edc4-4c4d-bd4b-c89a4020d116 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.922803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-dc065573-ec5e-4384-b138-c8c1cc09d0ad req-932519f3-edc4-4c4d-bd4b-c89a4020d116 service nova] Creating event network-vif-deleted:6ebe1443-a187-419b-b3fd-548c8b30dbb0 for instance 848dbdaf-18c0-4beb-a74b-5b6d09d5911f on hv-cinder-81268 Dec 15 19:07:06.927764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-dc065573-ec5e-4384-b138-c8c1cc09d0ad req-932519f3-edc4-4c4d-bd4b-c89a4020d116 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Dec 15 19:07:06.928380 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 402/755] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:06.946842 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-98003683-3143-4588-bed7-9594bf024371 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:06.947631 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-98003683-3143-4588-bed7-9594bf024371 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:06.955082 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-98003683-3143-4588-bed7-9594bf024371 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.955532 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-98003683-3143-4588-bed7-9594bf024371 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:06.956733 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-98003683-3143-4588-bed7-9594bf024371 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:06.956989 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-98003683-3143-4588-bed7-9594bf024371 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.012281 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c80ae5ac-8a95-497b-b2df-d5350fdd6c95 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:07.013008 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c80ae5ac-8a95-497b-b2df-d5350fdd6c95 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:07.019881 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c80ae5ac-8a95-497b-b2df-d5350fdd6c95 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.020410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c80ae5ac-8a95-497b-b2df-d5350fdd6c95 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.021241 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c80ae5ac-8a95-497b-b2df-d5350fdd6c95 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.021679 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c80ae5ac-8a95-497b-b2df-d5350fdd6c95 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.056460 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-98003683-3143-4588-bed7-9594bf024371 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 38226 microversion: 2.1 time: 0.113425 Dec 15 19:07:07.057453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 354/756] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:07:06 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 38226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:07:07.162714 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c80ae5ac-8a95-497b-b2df-d5350fdd6c95 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:07.170221 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c80ae5ac-8a95-497b-b2df-d5350fdd6c95 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.161887 Dec 15 19:07:07.170795 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 403/757] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:07 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:07.181485 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a6ceb63e-52cf-443f-8d01-f696238f3b2f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:07.182216 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a6ceb63e-52cf-443f-8d01-f696238f3b2f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:07.189729 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a6ceb63e-52cf-443f-8d01-f696238f3b2f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.190194 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a6ceb63e-52cf-443f-8d01-f696238f3b2f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.191013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a6ceb63e-52cf-443f-8d01-f696238f3b2f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.191453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a6ceb63e-52cf-443f-8d01-f696238f3b2f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.323504 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a6ceb63e-52cf-443f-8d01-f696238f3b2f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:07.332404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a6ceb63e-52cf-443f-8d01-f696238f3b2f tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1555 microversion: 2.1 time: 0.154983 Dec 15 19:07:07.332967 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 355/758] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:07 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:07.396445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-48529581-7c6e-4909-bf27-b38394600f48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:07.402992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-48529581-7c6e-4909-bf27-b38394600f48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:07.402992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-48529581-7c6e-4909-bf27-b38394600f48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.403269 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-48529581-7c6e-4909-bf27-b38394600f48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.403845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-48529581-7c6e-4909-bf27-b38394600f48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.404279 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-48529581-7c6e-4909-bf27-b38394600f48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.428475 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-48529581-7c6e-4909-bf27-b38394600f48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:07:07.589456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:07.590068 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:07.596334 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.596788 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.597622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.598052 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.628478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.628930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.629402 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lazy-loading 'fault' on Instance uuid 848dbdaf-18c0-4beb-a74b-5b6d09d5911f {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:07.666732 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e26d3fb9224a6a8b093b1ff7852430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64813529e60447d4a41fcf486adf44dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:07.674636 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a133f357-9d0c-4e79-917c-5abd2cd6818d tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 200 len: 1304 microversion: 2.1 time: 0.088812 Dec 15 19:07:07.675572 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 356/759] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:07 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:07.758675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-48529581-7c6e-4909-bf27-b38394600f48 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 204 len: 0 microversion: 2.1 time: 0.365646 Dec 15 19:07:07.759296 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 404/760] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:07:07 2021] DELETE /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:07:07.766956 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-23102373-2148-4599-b971-48a5cbde4b40 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:07.767811 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-23102373-2148-4599-b971-48a5cbde4b40 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:07.773746 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23102373-2148-4599-b971-48a5cbde4b40 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.774381 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23102373-2148-4599-b971-48a5cbde4b40 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.775354 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23102373-2148-4599-b971-48a5cbde4b40 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.775801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-23102373-2148-4599-b971-48a5cbde4b40 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.894902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:07.895760 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:07.901684 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.902311 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.902899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:07.903329 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:07.909766 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-23102373-2148-4599-b971-48a5cbde4b40 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:07.917004 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-23102373-2148-4599-b971-48a5cbde4b40 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1514 microversion: 2.1 time: 0.153692 Dec 15 19:07:07.917608 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 357/761] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:07 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:08.034128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:08.042235 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:08.043772 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:08.044917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f437a251-8079-4313-8061-b402e300eaf8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.154179 Dec 15 19:07:08.045523 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 405/762] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:07 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:08.068586 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1660c704-0b3c-41f6-8a15-c418485a4b03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:08.069606 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1660c704-0b3c-41f6-8a15-c418485a4b03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:08.075349 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1660c704-0b3c-41f6-8a15-c418485a4b03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.075798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1660c704-0b3c-41f6-8a15-c418485a4b03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.076579 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1660c704-0b3c-41f6-8a15-c418485a4b03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.077012 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1660c704-0b3c-41f6-8a15-c418485a4b03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.148908 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1660c704-0b3c-41f6-8a15-c418485a4b03 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 200 len: 38348 microversion: 2.1 time: 0.083767 Dec 15 19:07:08.149550 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 358/763] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:07:08 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 38348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:07:08.159838 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0956f068-d678-4ffc-bb00-2aeb16c3cb90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:08.160331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0956f068-d678-4ffc-bb00-2aeb16c3cb90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:08.166222 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0956f068-d678-4ffc-bb00-2aeb16c3cb90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.166682 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0956f068-d678-4ffc-bb00-2aeb16c3cb90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.167467 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0956f068-d678-4ffc-bb00-2aeb16c3cb90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.167903 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0956f068-d678-4ffc-bb00-2aeb16c3cb90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.187407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8d43e01e-a591-4d25-9dce-e8368ddd1bb7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:08.188423 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8d43e01e-a591-4d25-9dce-e8368ddd1bb7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:08.191841 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0956f068-d678-4ffc-bb00-2aeb16c3cb90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/ips" status: 200 len: 144 microversion: 2.1 time: 0.036046 Dec 15 19:07:08.192797 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 406/764] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Dec 15 19:07:08 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:08.195571 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8d43e01e-a591-4d25-9dce-e8368ddd1bb7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.196024 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8d43e01e-a591-4d25-9dce-e8368ddd1bb7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.196842 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8d43e01e-a591-4d25-9dce-e8368ddd1bb7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.197311 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8d43e01e-a591-4d25-9dce-e8368ddd1bb7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.354065 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c1744bd8-18e9-49e0-82cb-3767fb2d35fb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:08.354833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c1744bd8-18e9-49e0-82cb-3767fb2d35fb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:08.355693 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8d43e01e-a591-4d25-9dce-e8368ddd1bb7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:08.361432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c1744bd8-18e9-49e0-82cb-3767fb2d35fb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.362034 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c1744bd8-18e9-49e0-82cb-3767fb2d35fb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.362940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c1744bd8-18e9-49e0-82cb-3767fb2d35fb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.363522 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c1744bd8-18e9-49e0-82cb-3767fb2d35fb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.367810 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8d43e01e-a591-4d25-9dce-e8368ddd1bb7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.184335 Dec 15 19:07:08.368402 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 359/765] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:08 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:08.507842 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c1744bd8-18e9-49e0-82cb-3767fb2d35fb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:08.517730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c1744bd8-18e9-49e0-82cb-3767fb2d35fb tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1555 microversion: 2.1 time: 0.167835 Dec 15 19:07:08.518338 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 407/766] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:08 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:08.692202 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a9e666be-83ad-41df-89c8-218086565486 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:08.692868 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a9e666be-83ad-41df-89c8-218086565486 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] [instance: 848dbdaf-18c0-4beb-a74b-5b6d09d5911f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:08.699523 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9e666be-83ad-41df-89c8-218086565486 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.699979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9e666be-83ad-41df-89c8-218086565486 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.701819 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9e666be-83ad-41df-89c8-218086565486 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.701819 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9e666be-83ad-41df-89c8-218086565486 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.719322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-a9e666be-83ad-41df-89c8-218086565486 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] HTTP exception thrown: Instance 848dbdaf-18c0-4beb-a74b-5b6d09d5911f could not be found. Dec 15 19:07:08.719322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a9e666be-83ad-41df-89c8-218086565486 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] Returning 404 to user: Instance 848dbdaf-18c0-4beb-a74b-5b6d09d5911f could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:08.719322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a9e666be-83ad-41df-89c8-218086565486 tempest-VolumesNegativeTest-1100927625 tempest-VolumesNegativeTest-1100927625-project] 10.222.0.49 "GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f" status: 404 len: 111 microversion: 2.1 time: 0.028702 Dec 15 19:07:08.719322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 360/767] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:08 2021] GET /compute/v2.1/servers/848dbdaf-18c0-4beb-a74b-5b6d09d5911f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:07:08.934749 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0a4bc071-e911-4c90-a2a4-3ae6a9a2a35a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:08.935347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0a4bc071-e911-4c90-a2a4-3ae6a9a2a35a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:08.942270 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a4bc071-e911-4c90-a2a4-3ae6a9a2a35a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.942711 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a4bc071-e911-4c90-a2a4-3ae6a9a2a35a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:08.943497 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a4bc071-e911-4c90-a2a4-3ae6a9a2a35a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:08.943917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a4bc071-e911-4c90-a2a4-3ae6a9a2a35a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:09.065407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:09.067218 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:09.083734 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:09.084793 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:09.086118 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:09.086562 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:09.090538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0a4bc071-e911-4c90-a2a4-3ae6a9a2a35a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:09.098496 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0a4bc071-e911-4c90-a2a4-3ae6a9a2a35a tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1514 microversion: 2.1 time: 0.167365 Dec 15 19:07:09.099071 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 408/768] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:08 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:09.224778 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:09.232058 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:09.233579 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:09.235225 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-eb3d3dbf-84a1-4580-ad39-26304b14b0d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.174909 Dec 15 19:07:09.235776 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 361/769] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:09 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:09.384997 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6c1d1081-32f6-4c05-b517-1ea066c2ecd7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:09.385543 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6c1d1081-32f6-4c05-b517-1ea066c2ecd7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:09.391257 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c1d1081-32f6-4c05-b517-1ea066c2ecd7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:09.391699 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c1d1081-32f6-4c05-b517-1ea066c2ecd7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:09.392465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c1d1081-32f6-4c05-b517-1ea066c2ecd7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:09.392915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c1d1081-32f6-4c05-b517-1ea066c2ecd7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:09.529153 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6c1d1081-32f6-4c05-b517-1ea066c2ecd7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:09.534776 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f11f11cf-55f5-4784-894a-667ac3130168 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:09.535393 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f11f11cf-55f5-4784-894a-667ac3130168 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:09.537233 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6c1d1081-32f6-4c05-b517-1ea066c2ecd7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.155977 Dec 15 19:07:09.537801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 409/770] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:09 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:09.541405 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f11f11cf-55f5-4784-894a-667ac3130168 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:09.541867 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f11f11cf-55f5-4784-894a-667ac3130168 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:09.542651 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f11f11cf-55f5-4784-894a-667ac3130168 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:09.543090 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f11f11cf-55f5-4784-894a-667ac3130168 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:09.688473 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f11f11cf-55f5-4784-894a-667ac3130168 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:09.697151 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f11f11cf-55f5-4784-894a-667ac3130168 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1561 microversion: 2.1 time: 0.166440 Dec 15 19:07:09.697719 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 362/771] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:09 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:09.819115 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4119ffe9-0eb3-48e8-a18f-7290a2091ab4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:09.819802 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4119ffe9-0eb3-48e8-a18f-7290a2091ab4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:09.826894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4119ffe9-0eb3-48e8-a18f-7290a2091ab4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:09.827573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4119ffe9-0eb3-48e8-a18f-7290a2091ab4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:09.829044 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4119ffe9-0eb3-48e8-a18f-7290a2091ab4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:09.829654 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4119ffe9-0eb3-48e8-a18f-7290a2091ab4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:09.911904 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-4119ffe9-0eb3-48e8-a18f-7290a2091ab4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lazy-loading 'services' on Instance uuid 93f130e2-e041-400a-934f-9c837ba505ef {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:10.115106 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4c511070-74d7-4f88-ae85-8481ce044dff tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:10.115920 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4c511070-74d7-4f88-ae85-8481ce044dff tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:10.121823 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c511070-74d7-4f88-ae85-8481ce044dff tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:10.122291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c511070-74d7-4f88-ae85-8481ce044dff tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:10.123089 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c511070-74d7-4f88-ae85-8481ce044dff tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:10.123519 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c511070-74d7-4f88-ae85-8481ce044dff tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:10.146548 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4119ffe9-0eb3-48e8-a18f-7290a2091ab4 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "DELETE /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments/1f716fec-ed87-47fe-8800-55099d62e383" status: 202 len: 0 microversion: 2.1 time: 0.330831 Dec 15 19:07:10.147093 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 410/772] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:07:09 2021] DELETE /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments/1f716fec-ed87-47fe-8800-55099d62e383 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:07:10.155254 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-60272aa9-e5d0-4ea9-81ff-513037ddf5f3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:10.156326 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-60272aa9-e5d0-4ea9-81ff-513037ddf5f3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:10.162456 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-60272aa9-e5d0-4ea9-81ff-513037ddf5f3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:10.162905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-60272aa9-e5d0-4ea9-81ff-513037ddf5f3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:10.163700 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-60272aa9-e5d0-4ea9-81ff-513037ddf5f3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:10.164144 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-60272aa9-e5d0-4ea9-81ff-513037ddf5f3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:10.195398 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-60272aa9-e5d0-4ea9-81ff-513037ddf5f3 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Dec 15 19:07:10.195972 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 411/773] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:07:10 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:07:10.254447 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:10.255324 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:10.258045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4c511070-74d7-4f88-ae85-8481ce044dff tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:10.261517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:10.261977 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:10.262930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:10.263410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:10.266951 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4c511070-74d7-4f88-ae85-8481ce044dff tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1514 microversion: 2.1 time: 0.155438 Dec 15 19:07:10.267635 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 363/774] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:10 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:10.399942 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:10.408214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:10.409748 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:10.415183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7c43b459-0699-4bdb-8da3-7e93de0cc77d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.161026 Dec 15 19:07:10.415183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 412/775] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:10 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:07:10.554327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ef7c74a7-ff22-4cf1-8d2c-d437ed6b1d77 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:10.554941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ef7c74a7-ff22-4cf1-8d2c-d437ed6b1d77 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:10.560781 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ef7c74a7-ff22-4cf1-8d2c-d437ed6b1d77 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:10.561277 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ef7c74a7-ff22-4cf1-8d2c-d437ed6b1d77 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:10.562093 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ef7c74a7-ff22-4cf1-8d2c-d437ed6b1d77 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:10.563183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ef7c74a7-ff22-4cf1-8d2c-d437ed6b1d77 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:10.944595 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ef7c74a7-ff22-4cf1-8d2c-d437ed6b1d77 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:10.951801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ef7c74a7-ff22-4cf1-8d2c-d437ed6b1d77 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.401688 Dec 15 19:07:10.952361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 364/776] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:10 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:11.207214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-17103d63-7758-44dc-95f8-49cdd944d92e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:11.208194 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-17103d63-7758-44dc-95f8-49cdd944d92e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:11.215426 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17103d63-7758-44dc-95f8-49cdd944d92e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:11.215873 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17103d63-7758-44dc-95f8-49cdd944d92e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:11.216692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17103d63-7758-44dc-95f8-49cdd944d92e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:11.217158 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17103d63-7758-44dc-95f8-49cdd944d92e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:11.248292 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-17103d63-7758-44dc-95f8-49cdd944d92e tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Dec 15 19:07:11.249001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 413/777] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:07:11 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:11.283836 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f691c01f-c7e2-4080-8aed-a0e6571c680b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:11.284521 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f691c01f-c7e2-4080-8aed-a0e6571c680b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:11.290388 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f691c01f-c7e2-4080-8aed-a0e6571c680b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:11.290836 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f691c01f-c7e2-4080-8aed-a0e6571c680b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:11.291687 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f691c01f-c7e2-4080-8aed-a0e6571c680b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:11.292031 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f691c01f-c7e2-4080-8aed-a0e6571c680b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:11.427235 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f691c01f-c7e2-4080-8aed-a0e6571c680b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:11.428750 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:11.429461 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:11.435155 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:11.435604 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:11.435721 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f691c01f-c7e2-4080-8aed-a0e6571c680b tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1514 microversion: 2.1 time: 0.156020 Dec 15 19:07:11.436273 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 365/778] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:11 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:11.436428 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:11.436792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:11.571918 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:11.580862 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:11.582404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:11.583541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6aceeba9-1b9c-44a3-beaa-b7660af536b5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.158414 Dec 15 19:07:11.584094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 414/779] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:11 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:07:11.970105 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8aa19dcc-965b-41fd-806d-c60517764ad2 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:11.970918 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8aa19dcc-965b-41fd-806d-c60517764ad2 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:11.978209 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8aa19dcc-965b-41fd-806d-c60517764ad2 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:11.978905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8aa19dcc-965b-41fd-806d-c60517764ad2 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:11.979978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8aa19dcc-965b-41fd-806d-c60517764ad2 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:11.980449 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8aa19dcc-965b-41fd-806d-c60517764ad2 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:12.135164 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8aa19dcc-965b-41fd-806d-c60517764ad2 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:12.142928 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8aa19dcc-965b-41fd-806d-c60517764ad2 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.178461 Dec 15 19:07:12.143505 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 366/780] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:11 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:12.259994 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a667095b-b753-44c1-ba88-f183dd485e42 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:12.260989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a667095b-b753-44c1-ba88-f183dd485e42 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:12.267610 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a667095b-b753-44c1-ba88-f183dd485e42 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:12.268137 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a667095b-b753-44c1-ba88-f183dd485e42 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:12.269011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a667095b-b753-44c1-ba88-f183dd485e42 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:12.269545 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a667095b-b753-44c1-ba88-f183dd485e42 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:12.306863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a667095b-b753-44c1-ba88-f183dd485e42 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050571 Dec 15 19:07:12.310811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 415/781] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:07:12 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:12.453174 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-60c5fd9c-8892-4cc8-841e-de0f05c532a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:12.453730 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-60c5fd9c-8892-4cc8-841e-de0f05c532a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:12.459982 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-60c5fd9c-8892-4cc8-841e-de0f05c532a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:12.460432 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-60c5fd9c-8892-4cc8-841e-de0f05c532a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:12.461485 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-60c5fd9c-8892-4cc8-841e-de0f05c532a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:12.462069 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-60c5fd9c-8892-4cc8-841e-de0f05c532a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:12.602057 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:12.603132 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:12.609667 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:12.610121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:12.617548 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:12.617548 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:12.727033 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-60c5fd9c-8892-4cc8-841e-de0f05c532a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:12.747999 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-60c5fd9c-8892-4cc8-841e-de0f05c532a9 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1514 microversion: 2.1 time: 0.298861 Dec 15 19:07:12.748787 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 367/782] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:12 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1514 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:12.772655 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:12.780635 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:12.782823 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:12.783965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9c289fcf-0dc0-4d35-b9d4-e923e5270fbd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.186122 Dec 15 19:07:12.785074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 416/783] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:12 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:12.889939 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1418239501", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "networks": [{"uuid": "3bd0072d-daf7-4158-a223-046c35eb85a7"}]}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:12.944798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.network.neutron [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] validate_networks() for [('3bd0072d-daf7-4158-a223-046c35eb85a7', None, None, None, None, None)] {{(pid=116515) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:07:13.031606 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7178dd9e-5836-4efc-8990-0a96032c07bd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea99973f-7ebc-46dd-98f6-ed296c585a38"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:13.033295 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7178dd9e-5836-4efc-8990-0a96032c07bd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:13.038849 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7178dd9e-5836-4efc-8990-0a96032c07bd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.039371 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7178dd9e-5836-4efc-8990-0a96032c07bd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.040254 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7178dd9e-5836-4efc-8990-0a96032c07bd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.040754 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7178dd9e-5836-4efc-8990-0a96032c07bd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.428740 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Flavor limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:07:13.429210 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Image limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:07:13.429686 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Flavor pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:07:13.430097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Image pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:07:13.430540 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:07:13.440935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.441418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.442246 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.442681 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.459186 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Getting quotas for project 87416d9f16b34ae393890d3c16f8d55e. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:07:13.463217 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Getting quotas for user 9ad522630b4d4880b6e0e7b897a0a08d and project 87416d9f16b34ae393890d3c16f8d55e. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:07:13.474432 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Going to run 1 instances... {{(pid=116515) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:07:13.476788 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:07:13.578916 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3076c6df-c1ff-4403-b146-43a5e156b03d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692572 Dec 15 19:07:13.579568 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 368/784] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:07:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 19:07:13.583949 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-c05ae8e5-2223-4924-b430-5420fccc8828 req-54731048-b61c-4e04-b2b5-622c79239f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb865707-c2a0-4a91-9c92-70e29b1b2a48", "name": "network-vif-deleted", "tag": "4dcfb7ae-10e1-4733-8e99-a050c9e0f38a"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:13.585544 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:13.585544 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:07:13.592686 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-c05ae8e5-2223-4924-b430-5420fccc8828 req-54731048-b61c-4e04-b2b5-622c79239f71 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.593384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-c05ae8e5-2223-4924-b430-5420fccc8828 req-54731048-b61c-4e04-b2b5-622c79239f71 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.607309 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-c05ae8e5-2223-4924-b430-5420fccc8828 req-54731048-b61c-4e04-b2b5-622c79239f71 service nova] Creating event network-vif-deleted:4dcfb7ae-10e1-4733-8e99-a050c9e0f38a for instance eb865707-c2a0-4a91-9c92-70e29b1b2a48 on hv-cinder-81268 Dec 15 19:07:13.610507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-c05ae8e5-2223-4924-b430-5420fccc8828 req-54731048-b61c-4e04-b2b5-622c79239f71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029329 Dec 15 19:07:13.610854 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 369/785] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:13.615500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a378154e-b9c2-425f-9eb3-fd0dee61e59e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:13.616182 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a378154e-b9c2-425f-9eb3-fd0dee61e59e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:13.622158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a378154e-b9c2-425f-9eb3-fd0dee61e59e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.622614 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a378154e-b9c2-425f-9eb3-fd0dee61e59e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.623391 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a378154e-b9c2-425f-9eb3-fd0dee61e59e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.623817 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a378154e-b9c2-425f-9eb3-fd0dee61e59e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.768623 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a378154e-b9c2-425f-9eb3-fd0dee61e59e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:13.777185 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a378154e-b9c2-425f-9eb3-fd0dee61e59e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.165262 Dec 15 19:07:13.777810 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 370/786] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:13 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:13.784013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e709b2d7-b87d-4f18-84df-b4b943380837 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:13.785478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e709b2d7-b87d-4f18-84df-b4b943380837 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:13.790680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7178dd9e-5836-4efc-8990-0a96032c07bd tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765692 Dec 15 19:07:13.791300 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 417/787] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:07:13 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/os-volume_attachments => generated 194 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:07:13.792747 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e709b2d7-b87d-4f18-84df-b4b943380837 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.793816 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e709b2d7-b87d-4f18-84df-b4b943380837 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.794826 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e709b2d7-b87d-4f18-84df-b4b943380837 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.795331 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e709b2d7-b87d-4f18-84df-b4b943380837 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.797068 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-53e43403-9b0d-46ae-a6a7-4f030a2468c9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:13.798521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-53e43403-9b0d-46ae-a6a7-4f030a2468c9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:13.842182 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e709b2d7-b87d-4f18-84df-b4b943380837 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061783 Dec 15 19:07:13.844062 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 371/788] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:07:13 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:07:13.852524 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:13.855472 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:13.863475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.863920 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.865112 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.865616 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.877529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-53e43403-9b0d-46ae-a6a7-4f030a2468c9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:13.886065 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-53e43403-9b0d-46ae-a6a7-4f030a2468c9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1219 microversion: 2.1 time: 0.092620 Dec 15 19:07:13.886955 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 418/789] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:13 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:13.893141 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:13.901095 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:13.909210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.909846 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.911743 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.912314 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.914953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:13.915676 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:13.916139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lazy-loading 'fault' on Instance uuid eb865707-c2a0-4a91-9c92-70e29b1b2a48 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:13.975851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:13.993659 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6819a2b2-410a-46f3-a182-e2050dafb9ef tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 200 len: 1307 microversion: 2.1 time: 0.148358 Dec 15 19:07:13.994742 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 372/790] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:13 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:14.121060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:14.130626 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:14.132132 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:14.133415 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-948edaec-7759-4262-aac6-6d7c0e3fb4d3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.245267 Dec 15 19:07:14.134025 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 419/791] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:13 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:14.149340 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-a05fba49-e14d-4d90-8796-cc20e8ab82ab req-cd879c10-091b-4845-821e-45871bdbc42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688fbf24-7c98-4e51-8d6d-3a9f84044719", "name": "network-vif-plugged", "status": "completed", "tag": "3d828ab8-0ca7-48b9-813f-689cb063f4ad"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:14.150873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:14.150873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:07:14.158321 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-a05fba49-e14d-4d90-8796-cc20e8ab82ab req-cd879c10-091b-4845-821e-45871bdbc42a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:14.158777 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-a05fba49-e14d-4d90-8796-cc20e8ab82ab req-cd879c10-091b-4845-821e-45871bdbc42a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:14.171504 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-a05fba49-e14d-4d90-8796-cc20e8ab82ab req-cd879c10-091b-4845-821e-45871bdbc42a service nova] Creating event network-vif-plugged:3d828ab8-0ca7-48b9-813f-689cb063f4ad for instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 on hv-cinder-81268 Dec 15 19:07:14.178207 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-a05fba49-e14d-4d90-8796-cc20e8ab82ab req-cd879c10-091b-4845-821e-45871bdbc42a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031332 Dec 15 19:07:14.178207 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 373/792] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:14.793424 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-92e9a1fc-5676-4c77-81ec-bf285f13734f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:14.797621 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-92e9a1fc-5676-4c77-81ec-bf285f13734f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:14.802902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-92e9a1fc-5676-4c77-81ec-bf285f13734f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:14.803561 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-92e9a1fc-5676-4c77-81ec-bf285f13734f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:14.804458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-92e9a1fc-5676-4c77-81ec-bf285f13734f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:14.804899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-92e9a1fc-5676-4c77-81ec-bf285f13734f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:14.903622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bb75cb0e-59d8-475e-81a4-86b3b9155b9e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:14.904317 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bb75cb0e-59d8-475e-81a4-86b3b9155b9e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:14.920453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb75cb0e-59d8-475e-81a4-86b3b9155b9e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:14.920713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb75cb0e-59d8-475e-81a4-86b3b9155b9e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:14.922091 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb75cb0e-59d8-475e-81a4-86b3b9155b9e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:14.922534 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bb75cb0e-59d8-475e-81a4-86b3b9155b9e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:14.994487 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bb75cb0e-59d8-475e-81a4-86b3b9155b9e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:15.002694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bb75cb0e-59d8-475e-81a4-86b3b9155b9e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1223 microversion: 2.1 time: 0.103021 Dec 15 19:07:15.003263 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 374/793] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:14 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:15.012011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-92e9a1fc-5676-4c77-81ec-bf285f13734f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:15.018743 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0c6b5119-630e-4706-8b9f-bae544e1802e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:15.019932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0c6b5119-630e-4706-8b9f-bae544e1802e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: eb865707-c2a0-4a91-9c92-70e29b1b2a48] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:15.022505 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-92e9a1fc-5676-4c77-81ec-bf285f13734f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1263 microversion: 2.1 time: 0.232530 Dec 15 19:07:15.026969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 420/794] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:14 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1263 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:15.027515 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0c6b5119-630e-4706-8b9f-bae544e1802e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:15.028128 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0c6b5119-630e-4706-8b9f-bae544e1802e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:15.028919 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0c6b5119-630e-4706-8b9f-bae544e1802e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:15.029446 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0c6b5119-630e-4706-8b9f-bae544e1802e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:15.043418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-0c6b5119-630e-4706-8b9f-bae544e1802e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] HTTP exception thrown: Instance eb865707-c2a0-4a91-9c92-70e29b1b2a48 could not be found. Dec 15 19:07:15.044189 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0c6b5119-630e-4706-8b9f-bae544e1802e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Returning 404 to user: Instance eb865707-c2a0-4a91-9c92-70e29b1b2a48 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:15.045011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0c6b5119-630e-4706-8b9f-bae544e1802e tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48" status: 404 len: 111 microversion: 2.1 time: 0.030854 Dec 15 19:07:15.045580 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 375/795] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:15 2021] GET /compute/v2.1/servers/eb865707-c2a0-4a91-9c92-70e29b1b2a48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:07:15.054120 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-84f8e253-a41d-4e47-be1d-63b93919b058 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:15.054617 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-84f8e253-a41d-4e47-be1d-63b93919b058 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:15.060489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-84f8e253-a41d-4e47-be1d-63b93919b058 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:15.061634 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-84f8e253-a41d-4e47-be1d-63b93919b058 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:15.063005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-84f8e253-a41d-4e47-be1d-63b93919b058 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:15.063435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-84f8e253-a41d-4e47-be1d-63b93919b058 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:15.087428 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-84f8e253-a41d-4e47-be1d-63b93919b058 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:07:15.151421 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:15.152029 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:15.158011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:15.158465 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:15.159250 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:15.159688 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:15.309429 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:15.319204 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:15.320701 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:15.324912 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a0c66c90-93d1-4de7-baba-8f690490ad84 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.177147 Dec 15 19:07:15.325822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 376/796] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:15 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:07:15.415235 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-84f8e253-a41d-4e47-be1d-63b93919b058 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "DELETE /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 204 len: 0 microversion: 2.1 time: 0.364209 Dec 15 19:07:15.415787 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 421/797] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:07:15 2021] DELETE /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:07:15.424304 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-af91f83b-c095-4340-a798-db66820e968c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:15.425071 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-af91f83b-c095-4340-a798-db66820e968c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:15.431629 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af91f83b-c095-4340-a798-db66820e968c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:15.432149 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af91f83b-c095-4340-a798-db66820e968c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:15.432973 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af91f83b-c095-4340-a798-db66820e968c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:15.433447 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-af91f83b-c095-4340-a798-db66820e968c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:15.580314 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-af91f83b-c095-4340-a798-db66820e968c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:15.588288 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-af91f83b-c095-4340-a798-db66820e968c tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1513 microversion: 2.1 time: 0.168244 Dec 15 19:07:15.588907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 377/798] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:15 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:16.020439 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f631f0ec-466b-4399-9bcf-76f075ca2a75 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:16.021289 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f631f0ec-466b-4399-9bcf-76f075ca2a75 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:16.027897 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f631f0ec-466b-4399-9bcf-76f075ca2a75 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.028419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f631f0ec-466b-4399-9bcf-76f075ca2a75 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.029342 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f631f0ec-466b-4399-9bcf-76f075ca2a75 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.029851 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f631f0ec-466b-4399-9bcf-76f075ca2a75 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.041955 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e505b216-c6ac-41bc-beff-6d8ecd13cceb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:16.042559 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e505b216-c6ac-41bc-beff-6d8ecd13cceb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:16.049941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e505b216-c6ac-41bc-beff-6d8ecd13cceb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.050391 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e505b216-c6ac-41bc-beff-6d8ecd13cceb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.051189 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e505b216-c6ac-41bc-beff-6d8ecd13cceb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.051628 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e505b216-c6ac-41bc-beff-6d8ecd13cceb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.105715 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f631f0ec-466b-4399-9bcf-76f075ca2a75 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:16.113833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f631f0ec-466b-4399-9bcf-76f075ca2a75 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1279 microversion: 2.1 time: 0.097547 Dec 15 19:07:16.115167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 422/799] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:16 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:16.196336 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-83ae08c6-f66c-459b-84e3-cbcd54155d35 req-69074c96-86c9-4c2a-8091-47a38e77eaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93490542-6e11-41c3-9901-c06a1dd65cef", "name": "network-vif-plugged", "status": "completed", "tag": "2c56f2d3-88c3-4e37-b62b-41f5e58fee33"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:16.197920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:16.197920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:07:16.204981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-83ae08c6-f66c-459b-84e3-cbcd54155d35 req-69074c96-86c9-4c2a-8091-47a38e77eaf0 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.205497 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-83ae08c6-f66c-459b-84e3-cbcd54155d35 req-69074c96-86c9-4c2a-8091-47a38e77eaf0 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.216373 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-83ae08c6-f66c-459b-84e3-cbcd54155d35 req-69074c96-86c9-4c2a-8091-47a38e77eaf0 service nova] Creating event network-vif-plugged:2c56f2d3-88c3-4e37-b62b-41f5e58fee33 for instance 93490542-6e11-41c3-9901-c06a1dd65cef on hv-cinder-81268 Dec 15 19:07:16.222157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-83ae08c6-f66c-459b-84e3-cbcd54155d35 req-69074c96-86c9-4c2a-8091-47a38e77eaf0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033070 Dec 15 19:07:16.223474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 423/800] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:07:16.228484 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e505b216-c6ac-41bc-beff-6d8ecd13cceb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:16.236995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e505b216-c6ac-41bc-beff-6d8ecd13cceb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1450 microversion: 2.1 time: 0.198849 Dec 15 19:07:16.237616 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 378/801] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:16 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1450 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:16.256292 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ac54621b-a932-428a-b200-a3b928e38993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:16.257024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ac54621b-a932-428a-b200-a3b928e38993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:16.263470 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac54621b-a932-428a-b200-a3b928e38993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.263929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac54621b-a932-428a-b200-a3b928e38993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.264714 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac54621b-a932-428a-b200-a3b928e38993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.265193 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ac54621b-a932-428a-b200-a3b928e38993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.344045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:16.344779 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:16.350954 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.351477 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.352786 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.353330 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.409705 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ac54621b-a932-428a-b200-a3b928e38993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:16.417057 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ac54621b-a932-428a-b200-a3b928e38993 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1450 microversion: 2.1 time: 0.165246 Dec 15 19:07:16.417652 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 424/802] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:16 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:16.499376 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f26e165e-f2ae-406c-941e-a86615b736f2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:16.500035 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f26e165e-f2ae-406c-941e-a86615b736f2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:16.506820 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f26e165e-f2ae-406c-941e-a86615b736f2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.507275 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f26e165e-f2ae-406c-941e-a86615b736f2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.508625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f26e165e-f2ae-406c-941e-a86615b736f2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.508625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f26e165e-f2ae-406c-941e-a86615b736f2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.539278 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f26e165e-f2ae-406c-941e-a86615b736f2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:07:16.621786 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:16.634766 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:16.636526 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:16.637953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6dd97ceb-1cda-454d-a171-bf036c36260e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.298285 Dec 15 19:07:16.639904 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 379/803] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:16 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:16.645060 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4fb92635-3b03-4575-8bf9-909b56c8d172 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:16.645919 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4fb92635-3b03-4575-8bf9-909b56c8d172 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:16.652337 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4fb92635-3b03-4575-8bf9-909b56c8d172 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.652862 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4fb92635-3b03-4575-8bf9-909b56c8d172 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.653748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4fb92635-3b03-4575-8bf9-909b56c8d172 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.654414 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4fb92635-3b03-4575-8bf9-909b56c8d172 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.797529 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4fb92635-3b03-4575-8bf9-909b56c8d172 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:16.805147 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4fb92635-3b03-4575-8bf9-909b56c8d172 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1513 microversion: 2.1 time: 0.163939 Dec 15 19:07:16.805919 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 380/804] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:16 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:16.903395 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f26e165e-f2ae-406c-941e-a86615b736f2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 204 len: 0 microversion: 2.1 time: 0.407442 Dec 15 19:07:16.909316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 425/805] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:07:16 2021] DELETE /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:07:16.917342 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5f5fd2d8-dd2d-4dd4-baf5-b5fdcbbf6fce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:16.918053 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5f5fd2d8-dd2d-4dd4-baf5-b5fdcbbf6fce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:16.925037 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f5fd2d8-dd2d-4dd4-baf5-b5fdcbbf6fce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.925507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f5fd2d8-dd2d-4dd4-baf5-b5fdcbbf6fce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:16.926301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f5fd2d8-dd2d-4dd4-baf5-b5fdcbbf6fce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:16.926735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f5fd2d8-dd2d-4dd4-baf5-b5fdcbbf6fce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:17.133672 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5f5fd2d8-dd2d-4dd4-baf5-b5fdcbbf6fce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:17.136864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-78e48812-6e73-4485-a783-ea3d62b85413 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:17.142402 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-78e48812-6e73-4485-a783-ea3d62b85413 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:17.149777 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5f5fd2d8-dd2d-4dd4-baf5-b5fdcbbf6fce tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1508 microversion: 2.1 time: 0.236266 Dec 15 19:07:17.153419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78e48812-6e73-4485-a783-ea3d62b85413 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:17.163778 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 381/806] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:16 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:17.164435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78e48812-6e73-4485-a783-ea3d62b85413 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:17.165318 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78e48812-6e73-4485-a783-ea3d62b85413 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:17.165762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78e48812-6e73-4485-a783-ea3d62b85413 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:17.370381 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-78e48812-6e73-4485-a783-ea3d62b85413 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:17.378162 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-78e48812-6e73-4485-a783-ea3d62b85413 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1319 microversion: 2.1 time: 0.249599 Dec 15 19:07:17.387899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 426/807] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:17 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:17.656978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:17.658018 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:17.663820 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:17.664272 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:17.665069 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:17.665665 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:17.824827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-60a34248-dedd-40ca-b776-414c6846a7c4 req-08b0e1f2-ae03-412f-b5be-08f6ec99cba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6904bd6-619f-43a9-b7fa-5f91f0f9f824", "tag": "1375d4e0-7d19-44d5-aff8-8866d74f6b4e"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:17.826948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:17.826948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:07:17.837240 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-60a34248-dedd-40ca-b776-414c6846a7c4 req-08b0e1f2-ae03-412f-b5be-08f6ec99cba8 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:17.838006 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-60a34248-dedd-40ca-b776-414c6846a7c4 req-08b0e1f2-ae03-412f-b5be-08f6ec99cba8 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:17.851272 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-60a34248-dedd-40ca-b776-414c6846a7c4 req-08b0e1f2-ae03-412f-b5be-08f6ec99cba8 service nova] Creating event network-changed:1375d4e0-7d19-44d5-aff8-8866d74f6b4e for instance d6904bd6-619f-43a9-b7fa-5f91f0f9f824 on hv-cinder-81268 Dec 15 19:07:17.856562 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-60a34248-dedd-40ca-b776-414c6846a7c4 req-08b0e1f2-ae03-412f-b5be-08f6ec99cba8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037119 Dec 15 19:07:17.872248 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:17.877340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 427/808] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:17.882523 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5f21f371-13b6-493d-a08b-319d1a062520 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:17.883404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5f21f371-13b6-493d-a08b-319d1a062520 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:17.886194 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:17.888679 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:17.890217 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-94d157b0-1612-4263-8aba-5cde52138d56 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.237188 Dec 15 19:07:17.892082 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 382/809] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:17 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:17.907530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f21f371-13b6-493d-a08b-319d1a062520 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:17.908098 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f21f371-13b6-493d-a08b-319d1a062520 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:17.908894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f21f371-13b6-493d-a08b-319d1a062520 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:17.909356 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5f21f371-13b6-493d-a08b-319d1a062520 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:18.171451 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2c0d647b-46e5-4cf9-9ee2-bf81e6afe748 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:18.172207 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2c0d647b-46e5-4cf9-9ee2-bf81e6afe748 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:18.180655 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2c0d647b-46e5-4cf9-9ee2-bf81e6afe748 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:18.181917 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2c0d647b-46e5-4cf9-9ee2-bf81e6afe748 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:18.182924 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2c0d647b-46e5-4cf9-9ee2-bf81e6afe748 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:18.183731 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2c0d647b-46e5-4cf9-9ee2-bf81e6afe748 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:18.337507 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5f21f371-13b6-493d-a08b-319d1a062520 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:18.338680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5f21f371-13b6-493d-a08b-319d1a062520 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1513 microversion: 2.1 time: 0.460064 Dec 15 19:07:18.355564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 428/810] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:17 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1513 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:18.400493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-266be3ce-123a-45f6-b4b7-e0a25895ae22 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:18.400493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-266be3ce-123a-45f6-b4b7-e0a25895ae22 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:18.406655 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-266be3ce-123a-45f6-b4b7-e0a25895ae22 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:18.410324 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-266be3ce-123a-45f6-b4b7-e0a25895ae22 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:18.411392 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-266be3ce-123a-45f6-b4b7-e0a25895ae22 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:18.415198 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-266be3ce-123a-45f6-b4b7-e0a25895ae22 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:18.473363 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-2c0d647b-46e5-4cf9-9ee2-bf81e6afe748 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:18.486002 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2c0d647b-46e5-4cf9-9ee2-bf81e6afe748 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1508 microversion: 2.1 time: 0.318090 Dec 15 19:07:18.487182 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 383/811] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:18 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:18.752728 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-266be3ce-123a-45f6-b4b7-e0a25895ae22 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:18.762352 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-266be3ce-123a-45f6-b4b7-e0a25895ae22 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1319 microversion: 2.1 time: 0.370867 Dec 15 19:07:18.763648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 429/812] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:18 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:18.847993 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-4cf239cd-7779-4d99-bba7-3fe73bac3dfe req-8e1927ab-339c-44c9-8938-faf060ba1468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094752c1-e6f8-47d3-b40b-b20e8e8c12e6", "name": "network-vif-deleted", "tag": "b3a88158-4982-4b94-94f5-9d2a3ecf2eb1"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:18.850366 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:18.850366 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:07:18.857481 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-4cf239cd-7779-4d99-bba7-3fe73bac3dfe req-8e1927ab-339c-44c9-8938-faf060ba1468 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:18.857987 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-4cf239cd-7779-4d99-bba7-3fe73bac3dfe req-8e1927ab-339c-44c9-8938-faf060ba1468 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:18.874341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-4cf239cd-7779-4d99-bba7-3fe73bac3dfe req-8e1927ab-339c-44c9-8938-faf060ba1468 service nova] Creating event network-vif-deleted:b3a88158-4982-4b94-94f5-9d2a3ecf2eb1 for instance 094752c1-e6f8-47d3-b40b-b20e8e8c12e6 on hv-cinder-81268 Dec 15 19:07:18.880047 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-4cf239cd-7779-4d99-bba7-3fe73bac3dfe req-8e1927ab-339c-44c9-8938-faf060ba1468 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037209 Dec 15 19:07:18.881453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 384/813] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:18.914176 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:18.914821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:18.921802 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:18.922512 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:18.923310 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:18.923749 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:19.193144 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:19.202328 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:19.204626 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:19.205901 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-095ba74a-cabf-4449-8cb4-d36a3db5785c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.298758 Dec 15 19:07:19.206465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 430/814] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:18 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:19.356438 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:19.357269 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:19.363947 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:19.364511 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:19.368598 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:19.368598 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:19.401961 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:19.402415 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:19.402918 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lazy-loading 'fault' on Instance uuid 094752c1-e6f8-47d3-b40b-b20e8e8c12e6 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:19.445045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:19.452459 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a37d573b-47b1-401c-afba-3c9d20115d42 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 200 len: 1307 microversion: 2.1 time: 0.100195 Dec 15 19:07:19.462543 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 385/815] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:19 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:19.504245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-dff1885e-48b7-4132-a1b1-d3ef14527249 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:19.504942 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-dff1885e-48b7-4132-a1b1-d3ef14527249 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:19.510787 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dff1885e-48b7-4132-a1b1-d3ef14527249 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:19.511335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dff1885e-48b7-4132-a1b1-d3ef14527249 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:19.512195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dff1885e-48b7-4132-a1b1-d3ef14527249 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:19.512814 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dff1885e-48b7-4132-a1b1-d3ef14527249 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:19.659700 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-dff1885e-48b7-4132-a1b1-d3ef14527249 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:19.667164 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-dff1885e-48b7-4132-a1b1-d3ef14527249 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1508 microversion: 2.1 time: 0.167788 Dec 15 19:07:19.667944 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 431/816] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:19 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:19.780952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-961c662a-b34e-4bc2-8366-33a63a645a15 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:19.784168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-961c662a-b34e-4bc2-8366-33a63a645a15 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:19.791452 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-961c662a-b34e-4bc2-8366-33a63a645a15 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:19.792747 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-961c662a-b34e-4bc2-8366-33a63a645a15 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:19.793916 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-961c662a-b34e-4bc2-8366-33a63a645a15 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:19.794540 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-961c662a-b34e-4bc2-8366-33a63a645a15 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:19.953365 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-961c662a-b34e-4bc2-8366-33a63a645a15 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:19.960924 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-961c662a-b34e-4bc2-8366-33a63a645a15 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1319 microversion: 2.1 time: 0.184304 Dec 15 19:07:19.961575 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 386/817] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:19 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:20.225702 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:20.226335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:20.235987 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:20.236446 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:20.237317 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:20.241921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:20.440541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:20.450210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:20.451776 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:20.453112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-06967e60-63d3-4e74-a1e9-7ff1b9821710 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1803 microversion: 2.20 time: 0.231389 Dec 15 19:07:20.453710 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 432/818] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:20 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1803 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:07:20.468790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8acd364c-2d86-4e8c-a572-ed59bdf538aa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:20.469444 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8acd364c-2d86-4e8c-a572-ed59bdf538aa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 094752c1-e6f8-47d3-b40b-b20e8e8c12e6] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:20.476133 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8acd364c-2d86-4e8c-a572-ed59bdf538aa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:20.476582 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8acd364c-2d86-4e8c-a572-ed59bdf538aa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:20.477437 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8acd364c-2d86-4e8c-a572-ed59bdf538aa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:20.477864 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8acd364c-2d86-4e8c-a572-ed59bdf538aa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:20.498074 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-8acd364c-2d86-4e8c-a572-ed59bdf538aa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] HTTP exception thrown: Instance 094752c1-e6f8-47d3-b40b-b20e8e8c12e6 could not be found. Dec 15 19:07:20.498700 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8acd364c-2d86-4e8c-a572-ed59bdf538aa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Returning 404 to user: Instance 094752c1-e6f8-47d3-b40b-b20e8e8c12e6 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:20.499618 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8acd364c-2d86-4e8c-a572-ed59bdf538aa tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6" status: 404 len: 111 microversion: 2.1 time: 0.034671 Dec 15 19:07:20.504927 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 387/819] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:20 2021] GET /compute/v2.1/servers/094752c1-e6f8-47d3-b40b-b20e8e8c12e6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:07:20.684936 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6fdb96d0-dbd7-42a4-9993-f2d430858961 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:20.686215 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6fdb96d0-dbd7-42a4-9993-f2d430858961 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:20.696539 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fdb96d0-dbd7-42a4-9993-f2d430858961 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:20.697296 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fdb96d0-dbd7-42a4-9993-f2d430858961 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:20.701396 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fdb96d0-dbd7-42a4-9993-f2d430858961 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:20.701396 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fdb96d0-dbd7-42a4-9993-f2d430858961 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:20.762771 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6fdb96d0-dbd7-42a4-9993-f2d430858961 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:20.778583 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6fdb96d0-dbd7-42a4-9993-f2d430858961 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 200 len: 1466 microversion: 2.1 time: 0.090047 Dec 15 19:07:20.778583 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 433/820] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:20 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 1466 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:20.902165 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-a2423342-a2ae-436f-b45b-01d3af3a2d34 req-75d74d21-5425-4bfa-aaab-abd172e89f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688fbf24-7c98-4e51-8d6d-3a9f84044719", "tag": "3d828ab8-0ca7-48b9-813f-689cb063f4ad"}, {"server_uuid": "0f02ea25-0aca-4414-a953-d09699b8d014", "name": "network-vif-deleted", "tag": "98ba3766-39b5-4cc8-b78b-7acb892ea611"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:20.903859 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:20.903859 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:07:20.912311 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-a2423342-a2ae-436f-b45b-01d3af3a2d34 req-75d74d21-5425-4bfa-aaab-abd172e89f05 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:20.912759 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-a2423342-a2ae-436f-b45b-01d3af3a2d34 req-75d74d21-5425-4bfa-aaab-abd172e89f05 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:20.927952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-a2423342-a2ae-436f-b45b-01d3af3a2d34 req-75d74d21-5425-4bfa-aaab-abd172e89f05 service nova] Creating event network-changed:3d828ab8-0ca7-48b9-813f-689cb063f4ad for instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 on hv-cinder-81268 Dec 15 19:07:20.927952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-a2423342-a2ae-436f-b45b-01d3af3a2d34 req-75d74d21-5425-4bfa-aaab-abd172e89f05 service nova] Creating event network-vif-deleted:98ba3766-39b5-4cc8-b78b-7acb892ea611 for instance 0f02ea25-0aca-4414-a953-d09699b8d014 on hv-cinder-81268 Dec 15 19:07:20.931918 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-a2423342-a2ae-436f-b45b-01d3af3a2d34 req-75d74d21-5425-4bfa-aaab-abd172e89f05 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033745 Dec 15 19:07:20.932562 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 388/821] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:20 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:20.979243 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f91912ac-cd68-428f-9d30-f5f4189f7ae2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:20.979880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f91912ac-cd68-428f-9d30-f5f4189f7ae2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:20.985884 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f91912ac-cd68-428f-9d30-f5f4189f7ae2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:20.986338 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f91912ac-cd68-428f-9d30-f5f4189f7ae2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:20.987129 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f91912ac-cd68-428f-9d30-f5f4189f7ae2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:20.987590 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f91912ac-cd68-428f-9d30-f5f4189f7ae2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.187307 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f91912ac-cd68-428f-9d30-f5f4189f7ae2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:21.194418 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f91912ac-cd68-428f-9d30-f5f4189f7ae2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1319 microversion: 2.1 time: 0.219388 Dec 15 19:07:21.204266 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 434/822] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:20 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:21.370600 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-67335245-fa70-4b7d-bbed-310239699c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:21.379585 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-67335245-fa70-4b7d-bbed-310239699c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.380552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-67335245-fa70-4b7d-bbed-310239699c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.441570 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-67335245-fa70-4b7d-bbed-310239699c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Going to try to stop instance {{(pid=116515) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 19:07:21.471330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:21.471936 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:21.478173 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.478624 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.479410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.479838 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.635987 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-67335245-fa70-4b7d-bbed-310239699c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 202 len: 0 microversion: 2.1 time: 0.268923 Dec 15 19:07:21.636871 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 389/823] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:07:21 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:07:21.647662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9000fd43-ca44-4d81-b801-8077f60afaae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:21.648355 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9000fd43-ca44-4d81-b801-8077f60afaae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:21.650839 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:21.654653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9000fd43-ca44-4d81-b801-8077f60afaae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.655124 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9000fd43-ca44-4d81-b801-8077f60afaae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.656239 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9000fd43-ca44-4d81-b801-8077f60afaae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.656755 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9000fd43-ca44-4d81-b801-8077f60afaae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.659719 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:21.661301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:21.662932 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-263cc3a0-2e11-4dbb-aaab-8aa0d2e97a15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1790 microversion: 2.20 time: 0.195365 Dec 15 19:07:21.663491 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 435/824] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:07:21 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1790 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:07:21.788375 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c6edc1fb-2dbf-4d26-bc41-d90bfcba9ebc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:21.788981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c6edc1fb-2dbf-4d26-bc41-d90bfcba9ebc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 0f02ea25-0aca-4414-a953-d09699b8d014] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:21.795188 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c6edc1fb-2dbf-4d26-bc41-d90bfcba9ebc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.795630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c6edc1fb-2dbf-4d26-bc41-d90bfcba9ebc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.796409 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c6edc1fb-2dbf-4d26-bc41-d90bfcba9ebc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.796521 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9000fd43-ca44-4d81-b801-8077f60afaae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:21.796837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c6edc1fb-2dbf-4d26-bc41-d90bfcba9ebc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.806790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9000fd43-ca44-4d81-b801-8077f60afaae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.163790 Dec 15 19:07:21.807378 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 390/825] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:21 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:21.813878 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-538123f4-d2f3-4344-b50c-445789e12ac3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:21.814807 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-538123f4-d2f3-4344-b50c-445789e12ac3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:21.819442 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-c6edc1fb-2dbf-4d26-bc41-d90bfcba9ebc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] HTTP exception thrown: Instance 0f02ea25-0aca-4414-a953-d09699b8d014 could not be found. Dec 15 19:07:21.820038 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c6edc1fb-2dbf-4d26-bc41-d90bfcba9ebc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Returning 404 to user: Instance 0f02ea25-0aca-4414-a953-d09699b8d014 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:21.820866 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c6edc1fb-2dbf-4d26-bc41-d90bfcba9ebc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014" status: 404 len: 111 microversion: 2.1 time: 0.037183 Dec 15 19:07:21.822713 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 436/826] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:21 2021] GET /compute/v2.1/servers/0f02ea25-0aca-4414-a953-d09699b8d014 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:07:21.825876 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-538123f4-d2f3-4344-b50c-445789e12ac3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.826330 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-538123f4-d2f3-4344-b50c-445789e12ac3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.827137 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-538123f4-d2f3-4344-b50c-445789e12ac3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.827579 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-538123f4-d2f3-4344-b50c-445789e12ac3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.832335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a3ba9940-96d6-4a6f-9f56-d98e9659e234 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:21.832905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a3ba9940-96d6-4a6f-9f56-d98e9659e234 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:21.838620 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3ba9940-96d6-4a6f-9f56-d98e9659e234 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.839067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3ba9940-96d6-4a6f-9f56-d98e9659e234 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.839865 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3ba9940-96d6-4a6f-9f56-d98e9659e234 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:21.840296 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3ba9940-96d6-4a6f-9f56-d98e9659e234 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:21.852105 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-538123f4-d2f3-4344-b50c-445789e12ac3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:07:21.865564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a3ba9940-96d6-4a6f-9f56-d98e9659e234 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:07:22.158142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-538123f4-d2f3-4344-b50c-445789e12ac3 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 204 len: 0 microversion: 2.1 time: 0.349426 Dec 15 19:07:22.158742 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 391/827] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:07:21 2021] DELETE /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:07:22.166753 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bdb6a963-d567-44e6-8e70-323d9b8eb984 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:22.167444 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bdb6a963-d567-44e6-8e70-323d9b8eb984 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:22.173896 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bdb6a963-d567-44e6-8e70-323d9b8eb984 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:22.174346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bdb6a963-d567-44e6-8e70-323d9b8eb984 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:22.175157 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bdb6a963-d567-44e6-8e70-323d9b8eb984 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:22.175590 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bdb6a963-d567-44e6-8e70-323d9b8eb984 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:22.186141 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a3ba9940-96d6-4a6f-9f56-d98e9659e234 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "DELETE /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 204 len: 0 microversion: 2.1 time: 0.357046 Dec 15 19:07:22.187362 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 437/828] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:07:21 2021] DELETE /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:07:22.196155 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-387ae944-91ef-4cb4-bd0a-bb2bb4129daf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:22.196853 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-387ae944-91ef-4cb4-bd0a-bb2bb4129daf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:22.202860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-387ae944-91ef-4cb4-bd0a-bb2bb4129daf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:22.203315 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-387ae944-91ef-4cb4-bd0a-bb2bb4129daf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:22.204256 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-387ae944-91ef-4cb4-bd0a-bb2bb4129daf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:22.204691 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-387ae944-91ef-4cb4-bd0a-bb2bb4129daf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:22.314693 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bdb6a963-d567-44e6-8e70-323d9b8eb984 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:22.322109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bdb6a963-d567-44e6-8e70-323d9b8eb984 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1515 microversion: 2.1 time: 0.159125 Dec 15 19:07:22.322690 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 392/829] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:22 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:22.335954 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5e18600c-a4d1-408c-a134-7969684a0915 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:22.336563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5e18600c-a4d1-408c-a134-7969684a0915 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:22.342751 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e18600c-a4d1-408c-a134-7969684a0915 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:22.343212 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e18600c-a4d1-408c-a134-7969684a0915 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:22.343996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e18600c-a4d1-408c-a134-7969684a0915 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:22.344933 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e18600c-a4d1-408c-a134-7969684a0915 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:22.347923 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-387ae944-91ef-4cb4-bd0a-bb2bb4129daf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:22.355363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-387ae944-91ef-4cb4-bd0a-bb2bb4129daf tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.163724 Dec 15 19:07:22.357114 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 438/830] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:22 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:22.472396 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5e18600c-a4d1-408c-a134-7969684a0915 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:22.480003 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5e18600c-a4d1-408c-a134-7969684a0915 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1319 microversion: 2.1 time: 0.147451 Dec 15 19:07:22.480567 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 393/831] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:22 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:22.824768 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e491da36-1a58-4b69-9f49-9d3a8443371e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:22.825379 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e491da36-1a58-4b69-9f49-9d3a8443371e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:22.832254 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e491da36-1a58-4b69-9f49-9d3a8443371e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:22.832697 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e491da36-1a58-4b69-9f49-9d3a8443371e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:22.833495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e491da36-1a58-4b69-9f49-9d3a8443371e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:22.833929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e491da36-1a58-4b69-9f49-9d3a8443371e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:22.960157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e491da36-1a58-4b69-9f49-9d3a8443371e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:22.967810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e491da36-1a58-4b69-9f49-9d3a8443371e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.146696 Dec 15 19:07:22.968375 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 439/832] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:22 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:23.338911 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-05a41faa-4cb0-4fb1-9949-bbe4fbdee0bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:23.339523 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-05a41faa-4cb0-4fb1-9949-bbe4fbdee0bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:23.346003 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-05a41faa-4cb0-4fb1-9949-bbe4fbdee0bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:23.346446 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-05a41faa-4cb0-4fb1-9949-bbe4fbdee0bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:23.347210 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-05a41faa-4cb0-4fb1-9949-bbe4fbdee0bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:23.347638 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-05a41faa-4cb0-4fb1-9949-bbe4fbdee0bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:23.372677 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6c30ff99-08ea-4dee-9956-4c782282f237 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:23.373583 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6c30ff99-08ea-4dee-9956-4c782282f237 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:23.379790 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c30ff99-08ea-4dee-9956-4c782282f237 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:23.380242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c30ff99-08ea-4dee-9956-4c782282f237 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:23.381028 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c30ff99-08ea-4dee-9956-4c782282f237 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:23.381499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c30ff99-08ea-4dee-9956-4c782282f237 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:23.478325 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-05a41faa-4cb0-4fb1-9949-bbe4fbdee0bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:23.486374 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-05a41faa-4cb0-4fb1-9949-bbe4fbdee0bb tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1515 microversion: 2.1 time: 0.151012 Dec 15 19:07:23.487088 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 394/833] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:23 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:23.498203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-13b7d510-fc69-4ec2-a4c3-a97ea43c4076 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:23.498901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-13b7d510-fc69-4ec2-a4c3-a97ea43c4076 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:23.506623 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-13b7d510-fc69-4ec2-a4c3-a97ea43c4076 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:23.507451 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-13b7d510-fc69-4ec2-a4c3-a97ea43c4076 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:23.508625 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-13b7d510-fc69-4ec2-a4c3-a97ea43c4076 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:23.509262 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-13b7d510-fc69-4ec2-a4c3-a97ea43c4076 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:23.564468 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6c30ff99-08ea-4dee-9956-4c782282f237 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:23.564468 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6c30ff99-08ea-4dee-9956-4c782282f237 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.157133 Dec 15 19:07:23.564468 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 440/834] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:23 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:23.650500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-13b7d510-fc69-4ec2-a4c3-a97ea43c4076 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:23.657778 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-13b7d510-fc69-4ec2-a4c3-a97ea43c4076 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1319 microversion: 2.1 time: 0.164046 Dec 15 19:07:23.658453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 395/835] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:23 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:23.985197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b5143e26-8bc1-4439-b2d8-519fcad9f676 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:23.985837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b5143e26-8bc1-4439-b2d8-519fcad9f676 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:23.992139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b5143e26-8bc1-4439-b2d8-519fcad9f676 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:23.992586 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b5143e26-8bc1-4439-b2d8-519fcad9f676 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:23.993384 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b5143e26-8bc1-4439-b2d8-519fcad9f676 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:23.993818 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b5143e26-8bc1-4439-b2d8-519fcad9f676 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:24.130852 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b5143e26-8bc1-4439-b2d8-519fcad9f676 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:24.131124 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-27952cae-6299-40c9-a5da-48f01505e9c3 req-b9f699a7-9404-433b-9336-b8d71d0c450c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6904bd6-619f-43a9-b7fa-5f91f0f9f824", "name": "network-vif-plugged", "status": "completed", "tag": "1375d4e0-7d19-44d5-aff8-8866d74f6b4e"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:24.133384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:24.133384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:07:24.139362 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b5143e26-8bc1-4439-b2d8-519fcad9f676 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.158283 Dec 15 19:07:24.140348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 441/836] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:23 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:24.142388 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-27952cae-6299-40c9-a5da-48f01505e9c3 req-b9f699a7-9404-433b-9336-b8d71d0c450c service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:24.142838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-27952cae-6299-40c9-a5da-48f01505e9c3 req-b9f699a7-9404-433b-9336-b8d71d0c450c service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:24.153634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-27952cae-6299-40c9-a5da-48f01505e9c3 req-b9f699a7-9404-433b-9336-b8d71d0c450c service nova] Creating event network-vif-plugged:1375d4e0-7d19-44d5-aff8-8866d74f6b4e for instance d6904bd6-619f-43a9-b7fa-5f91f0f9f824 on hv-cinder-81268 Dec 15 19:07:24.158259 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-27952cae-6299-40c9-a5da-48f01505e9c3 req-b9f699a7-9404-433b-9336-b8d71d0c450c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036427 Dec 15 19:07:24.158844 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 396/837] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:07:24.504073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d383daad-52cc-46c3-9cbd-bc8f0ca65cdd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:24.504670 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d383daad-52cc-46c3-9cbd-bc8f0ca65cdd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:24.510472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d383daad-52cc-46c3-9cbd-bc8f0ca65cdd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:24.510915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d383daad-52cc-46c3-9cbd-bc8f0ca65cdd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:24.511719 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d383daad-52cc-46c3-9cbd-bc8f0ca65cdd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:24.512146 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d383daad-52cc-46c3-9cbd-bc8f0ca65cdd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:24.545073 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d9173362-3422-49e9-94fe-4700cb5bdfe2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:24.545796 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d9173362-3422-49e9-94fe-4700cb5bdfe2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:24.552907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d9173362-3422-49e9-94fe-4700cb5bdfe2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:24.553398 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d9173362-3422-49e9-94fe-4700cb5bdfe2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:24.554215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d9173362-3422-49e9-94fe-4700cb5bdfe2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:24.554652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d9173362-3422-49e9-94fe-4700cb5bdfe2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:24.688733 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d9173362-3422-49e9-94fe-4700cb5bdfe2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:24.696160 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d9173362-3422-49e9-94fe-4700cb5bdfe2 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.156031 Dec 15 19:07:24.696728 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 397/838] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:24 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:24.701403 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1fb82285-7d75-4052-929c-892ef982c704 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:24.706224 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1fb82285-7d75-4052-929c-892ef982c704 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:24.708462 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1fb82285-7d75-4052-929c-892ef982c704 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:24.708917 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1fb82285-7d75-4052-929c-892ef982c704 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:24.709725 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1fb82285-7d75-4052-929c-892ef982c704 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:24.710162 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1fb82285-7d75-4052-929c-892ef982c704 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:24.724815 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d383daad-52cc-46c3-9cbd-bc8f0ca65cdd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:24.732528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d383daad-52cc-46c3-9cbd-bc8f0ca65cdd tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1515 microversion: 2.1 time: 0.232629 Dec 15 19:07:24.735295 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 442/839] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:24 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:24.842635 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1fb82285-7d75-4052-929c-892ef982c704 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:24.850476 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1fb82285-7d75-4052-929c-892ef982c704 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1319 microversion: 2.1 time: 0.152584 Dec 15 19:07:24.851233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 398/840] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:24 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:25.010747 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-f475c9ef-bac3-4b42-8dc9-1ccf3383141e req-844ad6f3-117b-481e-9135-4eed5db08af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0314d560-94f2-4a77-a4ba-e572c16baf83", "name": "network-vif-deleted", "tag": "a45ea0ec-0077-419a-b2e9-6b0cc9fbca81"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:25.012367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:25.012367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:07:25.019637 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-f475c9ef-bac3-4b42-8dc9-1ccf3383141e req-844ad6f3-117b-481e-9135-4eed5db08af8 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.020078 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-f475c9ef-bac3-4b42-8dc9-1ccf3383141e req-844ad6f3-117b-481e-9135-4eed5db08af8 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.030663 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-f475c9ef-bac3-4b42-8dc9-1ccf3383141e req-844ad6f3-117b-481e-9135-4eed5db08af8 service nova] Creating event network-vif-deleted:a45ea0ec-0077-419a-b2e9-6b0cc9fbca81 for instance 0314d560-94f2-4a77-a4ba-e572c16baf83 on hv-cinder-81268 Dec 15 19:07:25.035746 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-f475c9ef-bac3-4b42-8dc9-1ccf3383141e req-844ad6f3-117b-481e-9135-4eed5db08af8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028755 Dec 15 19:07:25.036395 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 443/841] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:25.155892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e9b1320a-2bd2-4b7c-bbb7-5fbcbf408019 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:25.157251 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e9b1320a-2bd2-4b7c-bbb7-5fbcbf408019 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:25.163184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e9b1320a-2bd2-4b7c-bbb7-5fbcbf408019 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.163634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e9b1320a-2bd2-4b7c-bbb7-5fbcbf408019 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.164418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e9b1320a-2bd2-4b7c-bbb7-5fbcbf408019 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.164859 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e9b1320a-2bd2-4b7c-bbb7-5fbcbf408019 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.306622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e9b1320a-2bd2-4b7c-bbb7-5fbcbf408019 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:25.314366 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e9b1320a-2bd2-4b7c-bbb7-5fbcbf408019 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.162169 Dec 15 19:07:25.314938 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 399/842] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:25 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:25.713762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1f6460ba-0a4b-4b62-9cbb-3bdb544ef3cc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:25.714486 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1f6460ba-0a4b-4b62-9cbb-3bdb544ef3cc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:25.721172 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f6460ba-0a4b-4b62-9cbb-3bdb544ef3cc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.721618 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f6460ba-0a4b-4b62-9cbb-3bdb544ef3cc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.723460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f6460ba-0a4b-4b62-9cbb-3bdb544ef3cc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.723954 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f6460ba-0a4b-4b62-9cbb-3bdb544ef3cc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.750111 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:25.750715 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:25.768658 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.770591 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.770591 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.770796 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.807913 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.808520 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.809102 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lazy-loading 'fault' on Instance uuid 0314d560-94f2-4a77-a4ba-e572c16baf83 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:25.857539 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79566c6c23e4944aadc60c1957cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e4764fb4d34d5dbdd967080b99c537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:25.865950 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4896cad6-fe5c-4ede-b013-e96b2b09a737 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 200 len: 1308 microversion: 2.1 time: 0.119517 Dec 15 19:07:25.866907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 400/843] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:25 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:25.871434 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bd61bfb8-c615-4dba-a131-b610bdb4c17e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:25.872119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bd61bfb8-c615-4dba-a131-b610bdb4c17e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:25.878932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bd61bfb8-c615-4dba-a131-b610bdb4c17e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.879456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bd61bfb8-c615-4dba-a131-b610bdb4c17e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.880310 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bd61bfb8-c615-4dba-a131-b610bdb4c17e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:25.880819 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bd61bfb8-c615-4dba-a131-b610bdb4c17e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:25.885308 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1f6460ba-0a4b-4b62-9cbb-3bdb544ef3cc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:25.893726 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1f6460ba-0a4b-4b62-9cbb-3bdb544ef3cc tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.183985 Dec 15 19:07:25.894755 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 444/844] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:25 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:26.022199 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bd61bfb8-c615-4dba-a131-b610bdb4c17e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:26.029481 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bd61bfb8-c615-4dba-a131-b610bdb4c17e tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1319 microversion: 2.1 time: 0.161577 Dec 15 19:07:26.030050 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 401/845] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:25 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:26.331868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-33f0124f-ed29-462e-9f8f-bb280a3d8864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:26.332476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-33f0124f-ed29-462e-9f8f-bb280a3d8864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:26.338806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-33f0124f-ed29-462e-9f8f-bb280a3d8864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:26.341825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-33f0124f-ed29-462e-9f8f-bb280a3d8864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:26.341825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-33f0124f-ed29-462e-9f8f-bb280a3d8864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:26.341825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-33f0124f-ed29-462e-9f8f-bb280a3d8864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:26.468834 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-33f0124f-ed29-462e-9f8f-bb280a3d8864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:26.476967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-33f0124f-ed29-462e-9f8f-bb280a3d8864 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.148822 Dec 15 19:07:26.477569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 445/846] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:26 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:26.883540 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-27909d74-6597-4b3b-a807-d7c35d3f2a87 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:26.884158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-27909d74-6597-4b3b-a807-d7c35d3f2a87 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] [instance: 0314d560-94f2-4a77-a4ba-e572c16baf83] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:26.890610 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-27909d74-6597-4b3b-a807-d7c35d3f2a87 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:26.891759 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-27909d74-6597-4b3b-a807-d7c35d3f2a87 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:26.892545 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-27909d74-6597-4b3b-a807-d7c35d3f2a87 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:26.892983 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-27909d74-6597-4b3b-a807-d7c35d3f2a87 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:26.905954 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-27909d74-6597-4b3b-a807-d7c35d3f2a87 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] HTTP exception thrown: Instance 0314d560-94f2-4a77-a4ba-e572c16baf83 could not be found. Dec 15 19:07:26.908312 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-27909d74-6597-4b3b-a807-d7c35d3f2a87 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] Returning 404 to user: Instance 0314d560-94f2-4a77-a4ba-e572c16baf83 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:26.908312 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-27909d74-6597-4b3b-a807-d7c35d3f2a87 tempest-AttachVolumeNegativeTest-1014393393 tempest-AttachVolumeNegativeTest-1014393393-project] 10.222.0.49 "GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83" status: 404 len: 111 microversion: 2.1 time: 0.027486 Dec 15 19:07:26.908312 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 402/847] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:26 2021] GET /compute/v2.1/servers/0314d560-94f2-4a77-a4ba-e572c16baf83 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:07:26.910537 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c3b10cae-0ad1-4903-be93-6cf1f0e16207 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:26.911140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c3b10cae-0ad1-4903-be93-6cf1f0e16207 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:26.917106 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c3b10cae-0ad1-4903-be93-6cf1f0e16207 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:26.917560 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c3b10cae-0ad1-4903-be93-6cf1f0e16207 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:26.918401 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c3b10cae-0ad1-4903-be93-6cf1f0e16207 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:26.918835 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c3b10cae-0ad1-4903-be93-6cf1f0e16207 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:27.046609 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-94f9d623-0ccc-49ea-9e94-140c77c409d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:27.047890 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-94f9d623-0ccc-49ea-9e94-140c77c409d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:27.051351 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c3b10cae-0ad1-4903-be93-6cf1f0e16207 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:27.054228 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-94f9d623-0ccc-49ea-9e94-140c77c409d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:27.055013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-94f9d623-0ccc-49ea-9e94-140c77c409d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:27.055885 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-94f9d623-0ccc-49ea-9e94-140c77c409d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:27.056387 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-94f9d623-0ccc-49ea-9e94-140c77c409d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:27.061380 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c3b10cae-0ad1-4903-be93-6cf1f0e16207 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.154696 Dec 15 19:07:27.064252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 446/848] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:26 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:27.200447 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-94f9d623-0ccc-49ea-9e94-140c77c409d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:27.208327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-94f9d623-0ccc-49ea-9e94-140c77c409d2 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1508 microversion: 2.1 time: 0.165433 Dec 15 19:07:27.208893 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 403/849] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:27 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:27.229989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0af0e3ac-e83c-47a5-bb56-a70e723243d3 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fb0cbca-d72a-4dae-b136-d8c4e1c1b9f4", "device": "/dev/sdb"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:27.231150 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0af0e3ac-e83c-47a5-bb56-a70e723243d3 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:27.237105 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0af0e3ac-e83c-47a5-bb56-a70e723243d3 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:27.237570 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0af0e3ac-e83c-47a5-bb56-a70e723243d3 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:27.238381 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0af0e3ac-e83c-47a5-bb56-a70e723243d3 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:27.238811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0af0e3ac-e83c-47a5-bb56-a70e723243d3 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:27.494912 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b30f2603-40d2-4a85-896a-22717a5cbf87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:27.495445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b30f2603-40d2-4a85-896a-22717a5cbf87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:27.502029 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b30f2603-40d2-4a85-896a-22717a5cbf87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:27.502482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b30f2603-40d2-4a85-896a-22717a5cbf87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:27.503269 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b30f2603-40d2-4a85-896a-22717a5cbf87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:27.503711 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b30f2603-40d2-4a85-896a-22717a5cbf87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:27.660516 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b30f2603-40d2-4a85-896a-22717a5cbf87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:27.669040 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b30f2603-40d2-4a85-896a-22717a5cbf87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.177873 Dec 15 19:07:27.669640 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 404/850] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:27 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:07:27.977818 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0af0e3ac-e83c-47a5-bb56-a70e723243d3 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "POST /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756098 Dec 15 19:07:27.978443 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 447/851] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:07:27 2021] POST /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:28.079523 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1dbba0d4-ce9e-4bbe-9122-ca24233703a7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:28.080082 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1dbba0d4-ce9e-4bbe-9122-ca24233703a7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:28.086699 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1dbba0d4-ce9e-4bbe-9122-ca24233703a7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:28.091142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1dbba0d4-ce9e-4bbe-9122-ca24233703a7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:28.091142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1dbba0d4-ce9e-4bbe-9122-ca24233703a7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:28.091142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1dbba0d4-ce9e-4bbe-9122-ca24233703a7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:28.237723 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1dbba0d4-ce9e-4bbe-9122-ca24233703a7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:28.245016 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1dbba0d4-ce9e-4bbe-9122-ca24233703a7 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1521 microversion: 2.1 time: 0.169575 Dec 15 19:07:28.245648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 405/852] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:28 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:28.686682 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bc3eb76b-561f-4cf5-9152-950f743b2d86 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:28.687375 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bc3eb76b-561f-4cf5-9152-950f743b2d86 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:28.694559 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc3eb76b-561f-4cf5-9152-950f743b2d86 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:28.695065 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc3eb76b-561f-4cf5-9152-950f743b2d86 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:28.695913 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc3eb76b-561f-4cf5-9152-950f743b2d86 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:28.696358 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bc3eb76b-561f-4cf5-9152-950f743b2d86 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:28.830352 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bc3eb76b-561f-4cf5-9152-950f743b2d86 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:28.836967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bc3eb76b-561f-4cf5-9152-950f743b2d86 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.154222 Dec 15 19:07:28.837657 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 448/853] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:28 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:29.262427 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6fcacec6-06a8-4122-9f08-e5eeb97c6567 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:29.263027 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6fcacec6-06a8-4122-9f08-e5eeb97c6567 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:29.269660 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6fcacec6-06a8-4122-9f08-e5eeb97c6567 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:29.270105 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6fcacec6-06a8-4122-9f08-e5eeb97c6567 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:29.270885 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6fcacec6-06a8-4122-9f08-e5eeb97c6567 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:29.271318 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6fcacec6-06a8-4122-9f08-e5eeb97c6567 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:29.352599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6fcacec6-06a8-4122-9f08-e5eeb97c6567 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f423d3aad94b10b1d3b44d57fa6891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cadce2bfd827471ca4a8a1591d053c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:29.360019 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6fcacec6-06a8-4122-9f08-e5eeb97c6567 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 200 len: 1479 microversion: 2.1 time: 0.101308 Dec 15 19:07:29.360622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 406/854] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:29 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 1479 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:29.387535 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-561f0e51-20d0-447a-87bc-9c5568b532e8 req-10f1c6ef-c701-4bc4-8442-0d7750a14cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f130e2-e041-400a-934f-9c837ba505ef", "name": "network-vif-deleted", "tag": "314bc344-bc90-4467-84d5-ab3c08f0f363"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:29.389313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:29.389313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:07:29.397356 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-561f0e51-20d0-447a-87bc-9c5568b532e8 req-10f1c6ef-c701-4bc4-8442-0d7750a14cac service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:29.398201 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-561f0e51-20d0-447a-87bc-9c5568b532e8 req-10f1c6ef-c701-4bc4-8442-0d7750a14cac service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:29.409679 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-561f0e51-20d0-447a-87bc-9c5568b532e8 req-10f1c6ef-c701-4bc4-8442-0d7750a14cac service nova] Creating event network-vif-deleted:314bc344-bc90-4467-84d5-ab3c08f0f363 for instance 93f130e2-e041-400a-934f-9c837ba505ef on hv-cinder-81268 Dec 15 19:07:29.414782 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-561f0e51-20d0-447a-87bc-9c5568b532e8 req-10f1c6ef-c701-4bc4-8442-0d7750a14cac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032104 Dec 15 19:07:29.415369 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 449/855] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:07:29.854238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-01ebeac2-167a-4ee6-b284-adb75b4ae8e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:29.855872 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-01ebeac2-167a-4ee6-b284-adb75b4ae8e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:29.861324 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-01ebeac2-167a-4ee6-b284-adb75b4ae8e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:29.861778 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-01ebeac2-167a-4ee6-b284-adb75b4ae8e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:29.862565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-01ebeac2-167a-4ee6-b284-adb75b4ae8e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:29.863009 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-01ebeac2-167a-4ee6-b284-adb75b4ae8e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:29.997905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-01ebeac2-167a-4ee6-b284-adb75b4ae8e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:30.006725 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-01ebeac2-167a-4ee6-b284-adb75b4ae8e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.156108 Dec 15 19:07:30.007383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 407/856] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:29 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:30.377478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-17aaa97d-5bd2-437e-8295-4f20e531f730 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:30.378094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-17aaa97d-5bd2-437e-8295-4f20e531f730 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] [instance: 93f130e2-e041-400a-934f-9c837ba505ef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:30.384507 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17aaa97d-5bd2-437e-8295-4f20e531f730 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:30.384959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17aaa97d-5bd2-437e-8295-4f20e531f730 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:30.385792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17aaa97d-5bd2-437e-8295-4f20e531f730 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:30.386230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-17aaa97d-5bd2-437e-8295-4f20e531f730 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:30.399203 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-17aaa97d-5bd2-437e-8295-4f20e531f730 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] HTTP exception thrown: Instance 93f130e2-e041-400a-934f-9c837ba505ef could not be found. Dec 15 19:07:30.399945 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-17aaa97d-5bd2-437e-8295-4f20e531f730 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] Returning 404 to user: Instance 93f130e2-e041-400a-934f-9c837ba505ef could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:30.400587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-17aaa97d-5bd2-437e-8295-4f20e531f730 tempest-ServerRescueNegativeTestJSON-627018794 tempest-ServerRescueNegativeTestJSON-627018794-project] 10.222.0.49 "GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef" status: 404 len: 111 microversion: 2.1 time: 0.027696 Dec 15 19:07:30.401133 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 450/857] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:30 2021] GET /compute/v2.1/servers/93f130e2-e041-400a-934f-9c837ba505ef => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:07:31.023935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a8039d63-6c81-4b57-9cc6-c45eb1e321ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:31.024404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a8039d63-6c81-4b57-9cc6-c45eb1e321ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:31.031884 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a8039d63-6c81-4b57-9cc6-c45eb1e321ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:31.032422 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a8039d63-6c81-4b57-9cc6-c45eb1e321ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:31.033268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a8039d63-6c81-4b57-9cc6-c45eb1e321ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:31.033847 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a8039d63-6c81-4b57-9cc6-c45eb1e321ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:31.354861 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a8039d63-6c81-4b57-9cc6-c45eb1e321ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:31.362689 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a8039d63-6c81-4b57-9cc6-c45eb1e321ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.342910 Dec 15 19:07:31.363260 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 408/858] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:31 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:32.380315 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ca633c75-462d-43e1-89aa-9cee820956a2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:32.384375 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ca633c75-462d-43e1-89aa-9cee820956a2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:32.387601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ca633c75-462d-43e1-89aa-9cee820956a2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:32.388060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ca633c75-462d-43e1-89aa-9cee820956a2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:32.388843 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ca633c75-462d-43e1-89aa-9cee820956a2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:32.389293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ca633c75-462d-43e1-89aa-9cee820956a2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:32.538230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ca633c75-462d-43e1-89aa-9cee820956a2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:32.547769 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ca633c75-462d-43e1-89aa-9cee820956a2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.171129 Dec 15 19:07:32.557382 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 451/859] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:32 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:33.563815 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5f99980e-c85e-4f13-a2e8-3052d115a5c7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:33.564395 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5f99980e-c85e-4f13-a2e8-3052d115a5c7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:33.570821 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f99980e-c85e-4f13-a2e8-3052d115a5c7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:33.571280 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f99980e-c85e-4f13-a2e8-3052d115a5c7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:33.572467 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f99980e-c85e-4f13-a2e8-3052d115a5c7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:33.573105 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f99980e-c85e-4f13-a2e8-3052d115a5c7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:33.790086 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5f99980e-c85e-4f13-a2e8-3052d115a5c7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:33.798914 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5f99980e-c85e-4f13-a2e8-3052d115a5c7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.238778 Dec 15 19:07:33.800272 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 409/860] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:33 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:34.817270 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4caed335-4b33-49d0-883f-9f9a04aeb526 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:34.823846 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4caed335-4b33-49d0-883f-9f9a04aeb526 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:34.824853 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4caed335-4b33-49d0-883f-9f9a04aeb526 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:34.825335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4caed335-4b33-49d0-883f-9f9a04aeb526 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:34.826133 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4caed335-4b33-49d0-883f-9f9a04aeb526 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:34.826571 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4caed335-4b33-49d0-883f-9f9a04aeb526 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:34.965337 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4caed335-4b33-49d0-883f-9f9a04aeb526 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:34.983608 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4caed335-4b33-49d0-883f-9f9a04aeb526 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.169852 Dec 15 19:07:34.984863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 452/861] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:34 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:36.001907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8769bee1-b930-45ae-adc2-5cc3e85fe514 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:36.002522 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8769bee1-b930-45ae-adc2-5cc3e85fe514 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:36.009509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8769bee1-b930-45ae-adc2-5cc3e85fe514 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:36.009971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8769bee1-b930-45ae-adc2-5cc3e85fe514 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:36.010769 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8769bee1-b930-45ae-adc2-5cc3e85fe514 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:36.011192 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8769bee1-b930-45ae-adc2-5cc3e85fe514 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:36.143634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8769bee1-b930-45ae-adc2-5cc3e85fe514 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:36.151402 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8769bee1-b930-45ae-adc2-5cc3e85fe514 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.154068 Dec 15 19:07:36.151971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 410/862] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:35 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:37.168404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6c7914ac-3804-42a0-91da-577f6f5ad542 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:37.170069 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6c7914ac-3804-42a0-91da-577f6f5ad542 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:37.176180 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c7914ac-3804-42a0-91da-577f6f5ad542 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:37.176721 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c7914ac-3804-42a0-91da-577f6f5ad542 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:37.178041 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c7914ac-3804-42a0-91da-577f6f5ad542 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:37.184730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c7914ac-3804-42a0-91da-577f6f5ad542 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:37.330529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6c7914ac-3804-42a0-91da-577f6f5ad542 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:37.338260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6c7914ac-3804-42a0-91da-577f6f5ad542 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.173856 Dec 15 19:07:37.339170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 453/863] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:37 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:38.355987 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-086238df-6aad-4c97-9dc2-a0a104002080 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:38.356686 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-086238df-6aad-4c97-9dc2-a0a104002080 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:38.362996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-086238df-6aad-4c97-9dc2-a0a104002080 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:38.363450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-086238df-6aad-4c97-9dc2-a0a104002080 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:38.364231 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-086238df-6aad-4c97-9dc2-a0a104002080 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:38.364669 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-086238df-6aad-4c97-9dc2-a0a104002080 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:38.516718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-086238df-6aad-4c97-9dc2-a0a104002080 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:38.524895 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-086238df-6aad-4c97-9dc2-a0a104002080 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.172673 Dec 15 19:07:38.525434 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 411/864] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:38 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:39.541918 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bec5090a-aa77-4be9-89e8-67b353bbf365 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:39.542527 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bec5090a-aa77-4be9-89e8-67b353bbf365 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:39.549641 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bec5090a-aa77-4be9-89e8-67b353bbf365 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:39.550140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bec5090a-aa77-4be9-89e8-67b353bbf365 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:39.550924 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bec5090a-aa77-4be9-89e8-67b353bbf365 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:39.551364 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bec5090a-aa77-4be9-89e8-67b353bbf365 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:39.704601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bec5090a-aa77-4be9-89e8-67b353bbf365 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:39.714887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bec5090a-aa77-4be9-89e8-67b353bbf365 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.176483 Dec 15 19:07:39.715614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 454/865] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:39 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:40.732172 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b938208e-a1ac-4ab6-901e-ce456f1dbc62 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:40.733463 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b938208e-a1ac-4ab6-901e-ce456f1dbc62 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:40.739764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b938208e-a1ac-4ab6-901e-ce456f1dbc62 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:40.740215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b938208e-a1ac-4ab6-901e-ce456f1dbc62 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:40.740995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b938208e-a1ac-4ab6-901e-ce456f1dbc62 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:40.741579 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b938208e-a1ac-4ab6-901e-ce456f1dbc62 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:40.905023 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b938208e-a1ac-4ab6-901e-ce456f1dbc62 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:40.911942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b938208e-a1ac-4ab6-901e-ce456f1dbc62 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.183433 Dec 15 19:07:40.912507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 412/866] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:40 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:41.929184 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-98dbd7a7-6da8-4ac3-a716-08cfda819c2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:41.929779 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-98dbd7a7-6da8-4ac3-a716-08cfda819c2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:41.935959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-98dbd7a7-6da8-4ac3-a716-08cfda819c2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:41.936426 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-98dbd7a7-6da8-4ac3-a716-08cfda819c2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:41.937816 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-98dbd7a7-6da8-4ac3-a716-08cfda819c2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:41.938242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-98dbd7a7-6da8-4ac3-a716-08cfda819c2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:42.080831 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-98dbd7a7-6da8-4ac3-a716-08cfda819c2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:42.088661 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-98dbd7a7-6da8-4ac3-a716-08cfda819c2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.163192 Dec 15 19:07:42.089484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 455/867] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:41 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:43.105802 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-86311feb-c398-47cb-ae62-4ed443fd8a97 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:43.106595 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-86311feb-c398-47cb-ae62-4ed443fd8a97 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:43.112999 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-86311feb-c398-47cb-ae62-4ed443fd8a97 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:43.113496 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-86311feb-c398-47cb-ae62-4ed443fd8a97 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:43.114321 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-86311feb-c398-47cb-ae62-4ed443fd8a97 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:43.114762 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-86311feb-c398-47cb-ae62-4ed443fd8a97 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:43.248211 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-86311feb-c398-47cb-ae62-4ed443fd8a97 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:43.256521 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-86311feb-c398-47cb-ae62-4ed443fd8a97 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1722 microversion: 2.1 time: 0.154465 Dec 15 19:07:43.257103 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 413/868] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:43 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:44.273602 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-247edcd0-9678-479f-8f43-2c8a9ee0e32b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:44.274379 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-247edcd0-9678-479f-8f43-2c8a9ee0e32b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:44.280802 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-247edcd0-9678-479f-8f43-2c8a9ee0e32b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:44.281295 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-247edcd0-9678-479f-8f43-2c8a9ee0e32b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:44.282096 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-247edcd0-9678-479f-8f43-2c8a9ee0e32b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:44.282539 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-247edcd0-9678-479f-8f43-2c8a9ee0e32b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:44.426955 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-247edcd0-9678-479f-8f43-2c8a9ee0e32b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:44.434669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-247edcd0-9678-479f-8f43-2c8a9ee0e32b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1699 microversion: 2.1 time: 0.164795 Dec 15 19:07:44.435236 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 456/869] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:44 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1699 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:44.451717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c76694ab-7d26-4f2a-8f58-d1fd4c7efdee tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:44.458108 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c76694ab-7d26-4f2a-8f58-d1fd4c7efdee tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:44.458560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c76694ab-7d26-4f2a-8f58-d1fd4c7efdee tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:44.480132 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c76694ab-7d26-4f2a-8f58-d1fd4c7efdee tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Going to try to start instance {{(pid=116515) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 19:07:44.682693 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c76694ab-7d26-4f2a-8f58-d1fd4c7efdee tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 202 len: 0 microversion: 2.1 time: 0.234426 Dec 15 19:07:44.688040 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 414/870] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:07:44 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:07:44.695153 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f65f9d6c-7a81-4544-948a-9984de71ce66 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:44.695856 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f65f9d6c-7a81-4544-948a-9984de71ce66 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:44.701725 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f65f9d6c-7a81-4544-948a-9984de71ce66 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:44.702170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f65f9d6c-7a81-4544-948a-9984de71ce66 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:44.702940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f65f9d6c-7a81-4544-948a-9984de71ce66 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:44.703363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f65f9d6c-7a81-4544-948a-9984de71ce66 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:44.840765 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f65f9d6c-7a81-4544-948a-9984de71ce66 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:44.847840 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f65f9d6c-7a81-4544-948a-9984de71ce66 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1708 microversion: 2.1 time: 0.156424 Dec 15 19:07:44.848422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 457/871] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:44 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:45.866281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0bf2d9db-e14f-441e-961e-96ea8182100a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:45.867139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0bf2d9db-e14f-441e-961e-96ea8182100a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:45.875415 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0bf2d9db-e14f-441e-961e-96ea8182100a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:45.881609 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0bf2d9db-e14f-441e-961e-96ea8182100a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:45.881609 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0bf2d9db-e14f-441e-961e-96ea8182100a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:45.881609 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0bf2d9db-e14f-441e-961e-96ea8182100a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:46.013090 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0bf2d9db-e14f-441e-961e-96ea8182100a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:46.021040 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0bf2d9db-e14f-441e-961e-96ea8182100a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1708 microversion: 2.1 time: 0.159333 Dec 15 19:07:46.022229 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 415/872] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:45 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:47.038115 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0c066bb5-2d9c-45ae-b9e0-be9b86d7e424 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:47.038713 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0c066bb5-2d9c-45ae-b9e0-be9b86d7e424 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:47.048025 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c066bb5-2d9c-45ae-b9e0-be9b86d7e424 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:47.048578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c066bb5-2d9c-45ae-b9e0-be9b86d7e424 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:47.049513 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c066bb5-2d9c-45ae-b9e0-be9b86d7e424 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:47.050021 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c066bb5-2d9c-45ae-b9e0-be9b86d7e424 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:47.180897 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0c066bb5-2d9c-45ae-b9e0-be9b86d7e424 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:47.189319 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0c066bb5-2d9c-45ae-b9e0-be9b86d7e424 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1712 microversion: 2.1 time: 0.154874 Dec 15 19:07:47.189892 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 458/873] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:47 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1712 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:48.094750 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c88b36f0-be37-4e8d-b55c-5fcebeb00e1d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:48.095281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c88b36f0-be37-4e8d-b55c-5fcebeb00e1d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:48.101471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c88b36f0-be37-4e8d-b55c-5fcebeb00e1d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:48.101925 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c88b36f0-be37-4e8d-b55c-5fcebeb00e1d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:48.102703 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c88b36f0-be37-4e8d-b55c-5fcebeb00e1d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:48.103138 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c88b36f0-be37-4e8d-b55c-5fcebeb00e1d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:48.178925 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-c88b36f0-be37-4e8d-b55c-5fcebeb00e1d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lazy-loading 'services' on Instance uuid d6904bd6-619f-43a9-b7fa-5f91f0f9f824 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:48.396124 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c88b36f0-be37-4e8d-b55c-5fcebeb00e1d tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824/os-volume_attachments/5fb0cbca-d72a-4dae-b136-d8c4e1c1b9f4" status: 202 len: 0 microversion: 2.1 time: 0.305535 Dec 15 19:07:48.396718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 416/874] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:07:48 2021] DELETE /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824/os-volume_attachments/5fb0cbca-d72a-4dae-b136-d8c4e1c1b9f4 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:07:51.612482 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-866f200c-f546-4d02-b3f1-cfcf92f4f597 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:51.613047 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-866f200c-f546-4d02-b3f1-cfcf92f4f597 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:51.619528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-866f200c-f546-4d02-b3f1-cfcf92f4f597 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:51.622594 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-866f200c-f546-4d02-b3f1-cfcf92f4f597 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:51.622594 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-866f200c-f546-4d02-b3f1-cfcf92f4f597 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:51.622594 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-866f200c-f546-4d02-b3f1-cfcf92f4f597 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:51.648245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-866f200c-f546-4d02-b3f1-cfcf92f4f597 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:07:51.892888 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-866f200c-f546-4d02-b3f1-cfcf92f4f597 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 204 len: 0 microversion: 2.1 time: 0.283753 Dec 15 19:07:51.893930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 459/875] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:07:51 2021] DELETE /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:07:51.902764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ded8b796-31ac-4650-a6f9-02607ec9dfba tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:51.903482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ded8b796-31ac-4650-a6f9-02607ec9dfba tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:51.909742 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ded8b796-31ac-4650-a6f9-02607ec9dfba tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:51.910191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ded8b796-31ac-4650-a6f9-02607ec9dfba tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:51.910976 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ded8b796-31ac-4650-a6f9-02607ec9dfba tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:51.911414 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ded8b796-31ac-4650-a6f9-02607ec9dfba tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:52.053391 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ded8b796-31ac-4650-a6f9-02607ec9dfba tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:52.060773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ded8b796-31ac-4650-a6f9-02607ec9dfba tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1514 microversion: 2.1 time: 0.162514 Dec 15 19:07:52.061529 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 417/876] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:51 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:53.078669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-18ebfe47-d9ca-4d0f-8729-eedff3f55ce0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:53.079975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-18ebfe47-d9ca-4d0f-8729-eedff3f55ce0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:53.086252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-18ebfe47-d9ca-4d0f-8729-eedff3f55ce0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:53.086703 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-18ebfe47-d9ca-4d0f-8729-eedff3f55ce0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:53.087474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-18ebfe47-d9ca-4d0f-8729-eedff3f55ce0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:53.087935 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-18ebfe47-d9ca-4d0f-8729-eedff3f55ce0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:53.218532 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-18ebfe47-d9ca-4d0f-8729-eedff3f55ce0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:53.225718 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-18ebfe47-d9ca-4d0f-8729-eedff3f55ce0 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1514 microversion: 2.1 time: 0.151128 Dec 15 19:07:53.226287 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 460/877] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:53 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:54.242802 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6f3967ba-e590-4233-82ca-b5eca3ba20c5 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:54.243320 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6f3967ba-e590-4233-82ca-b5eca3ba20c5 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:54.250103 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f3967ba-e590-4233-82ca-b5eca3ba20c5 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:54.250555 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f3967ba-e590-4233-82ca-b5eca3ba20c5 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:54.251867 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f3967ba-e590-4233-82ca-b5eca3ba20c5 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:54.252299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f3967ba-e590-4233-82ca-b5eca3ba20c5 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:54.428263 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-0debfcc2-133e-4acb-95e0-565f06f43079 req-23756e9d-3167-42cd-90d8-6174b5d5d1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6904bd6-619f-43a9-b7fa-5f91f0f9f824", "name": "network-vif-deleted", "tag": "1375d4e0-7d19-44d5-aff8-8866d74f6b4e"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:07:54.429874 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:07:54.429874 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:07:54.437469 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-0debfcc2-133e-4acb-95e0-565f06f43079 req-23756e9d-3167-42cd-90d8-6174b5d5d1c8 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:54.437920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-0debfcc2-133e-4acb-95e0-565f06f43079 req-23756e9d-3167-42cd-90d8-6174b5d5d1c8 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:54.449074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-0debfcc2-133e-4acb-95e0-565f06f43079 req-23756e9d-3167-42cd-90d8-6174b5d5d1c8 service nova] Creating event network-vif-deleted:1375d4e0-7d19-44d5-aff8-8866d74f6b4e for instance d6904bd6-619f-43a9-b7fa-5f91f0f9f824 on hv-cinder-81268 Dec 15 19:07:54.454955 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6f3967ba-e590-4233-82ca-b5eca3ba20c5 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:54.455625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-0debfcc2-133e-4acb-95e0-565f06f43079 req-23756e9d-3167-42cd-90d8-6174b5d5d1c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031296 Dec 15 19:07:54.456287 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 461/878] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:07:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:07:54.462864 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6f3967ba-e590-4233-82ca-b5eca3ba20c5 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1514 microversion: 2.1 time: 0.223819 Dec 15 19:07:54.463464 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 418/879] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:54 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:55.483837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:55.484586 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:55.491257 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:55.491950 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:55.492937 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:55.493403 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:55.524710 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:55.525184 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:55.525640 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lazy-loading 'fault' on Instance uuid d6904bd6-619f-43a9-b7fa-5f91f0f9f824 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:07:55.570445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad522630b4d4880b6e0e7b897a0a08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87416d9f16b34ae393890d3c16f8d55e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:07:55.582989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-27f9d592-c3bf-4a9a-9509-1afcf8393aa9 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 200 len: 1309 microversion: 2.1 time: 0.099256 Dec 15 19:07:55.582989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 462/880] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:55 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:07:56.595974 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-943de6ae-faa3-4ae0-a601-1eae781a0320 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:07:56.596583 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-943de6ae-faa3-4ae0-a601-1eae781a0320 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] [instance: d6904bd6-619f-43a9-b7fa-5f91f0f9f824] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:07:56.602883 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-943de6ae-faa3-4ae0-a601-1eae781a0320 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:56.603335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-943de6ae-faa3-4ae0-a601-1eae781a0320 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:56.604108 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-943de6ae-faa3-4ae0-a601-1eae781a0320 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:07:56.604542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-943de6ae-faa3-4ae0-a601-1eae781a0320 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:07:56.617466 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-943de6ae-faa3-4ae0-a601-1eae781a0320 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] HTTP exception thrown: Instance d6904bd6-619f-43a9-b7fa-5f91f0f9f824 could not be found. Dec 15 19:07:56.618046 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-943de6ae-faa3-4ae0-a601-1eae781a0320 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] Returning 404 to user: Instance d6904bd6-619f-43a9-b7fa-5f91f0f9f824 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:07:56.618851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-943de6ae-faa3-4ae0-a601-1eae781a0320 tempest-VolumesSnapshotTestJSON-1454917386 tempest-VolumesSnapshotTestJSON-1454917386-project] 10.222.0.49 "GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824" status: 404 len: 111 microversion: 2.1 time: 0.026843 Dec 15 19:07:56.619373 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 419/881] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:07:56 2021] GET /compute/v2.1/servers/d6904bd6-619f-43a9-b7fa-5f91f0f9f824 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:08:11.332019 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-378169bc-f7ae-4ce7-ae03-7f1fb2058532 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:11.335412 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-378169bc-f7ae-4ce7-ae03-7f1fb2058532 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:11.339902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-378169bc-f7ae-4ce7-ae03-7f1fb2058532 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:11.340353 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-378169bc-f7ae-4ce7-ae03-7f1fb2058532 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:11.341278 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-378169bc-f7ae-4ce7-ae03-7f1fb2058532 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:11.341710 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-378169bc-f7ae-4ce7-ae03-7f1fb2058532 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:11.373407 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-378169bc-f7ae-4ce7-ae03-7f1fb2058532 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments/f8237816-6020-4013-8383-a1f925ff90a2" status: 200 len: 194 microversion: 2.20 time: 0.045567 Dec 15 19:08:11.379734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 463/882] 10.222.0.49 () {60 vars in 1453 bytes} [Wed Dec 15 19:08:11 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments/f8237816-6020-4013-8383-a1f925ff90a2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:08:11.437373 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-eac93d1e-95c7-449d-8e22-16e093ded045 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:11.437860 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-eac93d1e-95c7-449d-8e22-16e093ded045 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:11.444970 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eac93d1e-95c7-449d-8e22-16e093ded045 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:11.445633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eac93d1e-95c7-449d-8e22-16e093ded045 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:11.446552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eac93d1e-95c7-449d-8e22-16e093ded045 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:11.446995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eac93d1e-95c7-449d-8e22-16e093ded045 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:11.527615 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-eac93d1e-95c7-449d-8e22-16e093ded045 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lazy-loading 'services' on Instance uuid 93490542-6e11-41c3-9901-c06a1dd65cef {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:08:11.759923 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-eac93d1e-95c7-449d-8e22-16e093ded045 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments/f8237816-6020-4013-8383-a1f925ff90a2" status: 202 len: 0 microversion: 2.20 time: 0.326973 Dec 15 19:08:11.760708 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 420/883] 10.222.0.49 () {60 vars in 1456 bytes} [Wed Dec 15 19:08:11 2021] DELETE /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments/f8237816-6020-4013-8383-a1f925ff90a2 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:08:11.771055 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0c096cdf-4e0c-483c-908f-749900ea5bf1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:11.772682 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0c096cdf-4e0c-483c-908f-749900ea5bf1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:11.779668 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c096cdf-4e0c-483c-908f-749900ea5bf1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:11.780128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c096cdf-4e0c-483c-908f-749900ea5bf1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:11.780915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c096cdf-4e0c-483c-908f-749900ea5bf1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:11.781368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c096cdf-4e0c-483c-908f-749900ea5bf1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:11.812862 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0c096cdf-4e0c-483c-908f-749900ea5bf1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047695 Dec 15 19:08:11.813465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 464/884] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Dec 15 19:08:11 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:08:12.827171 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-76848f70-8998-4bc9-8e4f-ac7400e87aec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:12.829196 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-76848f70-8998-4bc9-8e4f-ac7400e87aec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:12.840858 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76848f70-8998-4bc9-8e4f-ac7400e87aec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:12.842973 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76848f70-8998-4bc9-8e4f-ac7400e87aec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:12.842973 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76848f70-8998-4bc9-8e4f-ac7400e87aec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:12.842973 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-76848f70-8998-4bc9-8e4f-ac7400e87aec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:12.891485 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-76848f70-8998-4bc9-8e4f-ac7400e87aec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070532 Dec 15 19:08:12.892677 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 421/885] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Dec 15 19:08:12 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:08:13.908826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8fcd42cf-a18a-42b0-b41a-7b4c4f776d10 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:13.910506 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8fcd42cf-a18a-42b0-b41a-7b4c4f776d10 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:13.926015 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fcd42cf-a18a-42b0-b41a-7b4c4f776d10 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:13.926472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fcd42cf-a18a-42b0-b41a-7b4c4f776d10 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:13.927265 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fcd42cf-a18a-42b0-b41a-7b4c4f776d10 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:13.927751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fcd42cf-a18a-42b0-b41a-7b4c4f776d10 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:13.956968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8fcd42cf-a18a-42b0-b41a-7b4c4f776d10 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052598 Dec 15 19:08:13.958067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 465/886] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Dec 15 19:08:13 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:14.016306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-092ec08b-2ed7-467e-bdfb-28dc58847f36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:14.016821 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-092ec08b-2ed7-467e-bdfb-28dc58847f36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:14.023208 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-092ec08b-2ed7-467e-bdfb-28dc58847f36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:14.023654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-092ec08b-2ed7-467e-bdfb-28dc58847f36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:14.024541 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-092ec08b-2ed7-467e-bdfb-28dc58847f36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:14.024972 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-092ec08b-2ed7-467e-bdfb-28dc58847f36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:14.049684 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-092ec08b-2ed7-467e-bdfb-28dc58847f36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:08:14.340476 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-092ec08b-2ed7-467e-bdfb-28dc58847f36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 204 len: 0 microversion: 2.20 time: 0.327642 Dec 15 19:08:14.341072 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 422/887] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Dec 15 19:08:14 2021] DELETE /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 19:08:14.349347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:14.350103 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:14.356640 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:14.357115 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:14.358076 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:14.358684 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:14.515954 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:14.524024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:14.525693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:14.526854 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-395349a6-291f-4e9e-aee3-7fcbf9259489 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.181291 Dec 15 19:08:14.527412 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 466/888] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:14 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:15.546198 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:15.547017 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:15.553895 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:15.554359 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:15.555165 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:15.555596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:15.694706 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:15.702440 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:15.703953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:15.705126 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-74d63b2e-830b-4e22-9464-4d87a260bda2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1718 microversion: 2.20 time: 0.162986 Dec 15 19:08:15.705691 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 423/889] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:15 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:16.722933 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:16.724169 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:16.730959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:16.731520 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:16.732313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:16.732750 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:16.814863 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:16.824138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:16.826090 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:16.827544 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3efcbca2-a15a-4b3d-acd8-3791649d7d28 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1651 microversion: 2.20 time: 0.108739 Dec 15 19:08:16.839553 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 467/890] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:16 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1651 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:08:17.226665 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-80680f3a-1701-4891-b5bc-bc5c5f604f7a req-d8d88b76-8905-404d-b437-fe74576b7dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93490542-6e11-41c3-9901-c06a1dd65cef", "name": "network-vif-deleted", "tag": "2c56f2d3-88c3-4e37-b62b-41f5e58fee33"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:17.229498 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:08:17.229498 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:08:17.237235 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-80680f3a-1701-4891-b5bc-bc5c5f604f7a req-d8d88b76-8905-404d-b437-fe74576b7dc2 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:17.237682 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-80680f3a-1701-4891-b5bc-bc5c5f604f7a req-d8d88b76-8905-404d-b437-fe74576b7dc2 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:17.250290 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-80680f3a-1701-4891-b5bc-bc5c5f604f7a req-d8d88b76-8905-404d-b437-fe74576b7dc2 service nova] Creating event network-vif-deleted:2c56f2d3-88c3-4e37-b62b-41f5e58fee33 for instance 93490542-6e11-41c3-9901-c06a1dd65cef on hv-cinder-81268 Dec 15 19:08:17.257834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-80680f3a-1701-4891-b5bc-bc5c5f604f7a req-d8d88b76-8905-404d-b437-fe74576b7dc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035296 Dec 15 19:08:17.258434 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 424/891] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:08:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:08:17.846602 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:17.848689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:17.856327 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:17.857003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:17.858177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:17.858802 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:17.892910 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:17.893633 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:17.894766 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lazy-loading 'fault' on Instance uuid 93490542-6e11-41c3-9901-c06a1dd65cef {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:08:17.951687 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:17.962946 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:17.965197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:17.967621 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6a8bfe91-76a7-49bc-867c-8ea08b622061 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 200 len: 1368 microversion: 2.20 time: 0.124261 Dec 15 19:08:17.979666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 468/892] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:17 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:18.986846 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-707fd114-b532-4507-ad70-81b83248d271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:18.987542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-707fd114-b532-4507-ad70-81b83248d271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:18.997360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-707fd114-b532-4507-ad70-81b83248d271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:18.997360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-707fd114-b532-4507-ad70-81b83248d271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:18.997360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-707fd114-b532-4507-ad70-81b83248d271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:18.997360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-707fd114-b532-4507-ad70-81b83248d271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:19.010109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-707fd114-b532-4507-ad70-81b83248d271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] HTTP exception thrown: Instance 93490542-6e11-41c3-9901-c06a1dd65cef could not be found. Dec 15 19:08:19.010889 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-707fd114-b532-4507-ad70-81b83248d271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Returning 404 to user: Instance 93490542-6e11-41c3-9901-c06a1dd65cef could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:08:19.011715 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-707fd114-b532-4507-ad70-81b83248d271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 404 len: 111 microversion: 2.20 time: 0.029612 Dec 15 19:08:19.012306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 425/893] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:18 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 19:08:19.021151 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ce73cad3-a7ca-4830-aeab-8dc5115ad933 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '.version_select at 0x7f80b60f9b80>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:19.190155 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ce73cad3-a7ca-4830-aeab-8dc5115ad933 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7832612" status: 204 len: 0 microversion: 2.20 time: 0.173226 Dec 15 19:08:19.191458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 469/894] 10.222.0.49 () {60 vars in 1252 bytes} [Wed Dec 15 19:08:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7832612 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 19:08:20.039170 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4fe4692f-6577-4c39-ba65-e789ede8eeba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'create', calling method: .version_select at 0x7f80b59b4ee0>, body: {"keypair": {"name": "tempest-keypair-1238901625"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:20.053956 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4fe4692f-6577-4c39-ba65-e789ede8eeba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:08:20.072410 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4fe4692f-6577-4c39-ba65-e789ede8eeba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for user 497f05dbb53e48a38abf9529018d1766 and project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:08:20.665324 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4fe4692f-6577-4c39-ba65-e789ede8eeba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:08:20.669780 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4fe4692f-6577-4c39-ba65-e789ede8eeba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for user 497f05dbb53e48a38abf9529018d1766 and project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:08:20.685022 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4fe4692f-6577-4c39-ba65-e789ede8eeba tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.649367 Dec 15 19:08:20.685919 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 426/895] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Dec 15 19:08:20 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 651 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 19:08:23.424409 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-668fce78-1f36-4cda-8ddf-1070b1cff0e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:23.427434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-668fce78-1f36-4cda-8ddf-1070b1cff0e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:23.448930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-668fce78-1f36-4cda-8ddf-1070b1cff0e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:23.449738 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-668fce78-1f36-4cda-8ddf-1070b1cff0e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:23.450964 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-668fce78-1f36-4cda-8ddf-1070b1cff0e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:23.452692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-668fce78-1f36-4cda-8ddf-1070b1cff0e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:23.561633 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-668fce78-1f36-4cda-8ddf-1070b1cff0e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lazy-loading 'services' on Instance uuid 92d9554d-bb60-4d4e-9ab8-311caafb659f {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:08:23.698393 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1470735214", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcfdb591-816a-44d0-9526-48dd9abde6af"}], "security_groups": [{"name": "tempest-securitygroup--1784997293"}], "key_name": "tempest-keypair-1238901625", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:23.931546 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.network.neutron [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] validate_networks() for [('fcfdb591-816a-44d0-9526-48dd9abde6af', None, None, None, None, None)] {{(pid=116515) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:08:23.988379 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-668fce78-1f36-4cda-8ddf-1070b1cff0e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/os-volume_attachments/ea99973f-7ebc-46dd-98f6-ed296c585a38" status: 202 len: 0 microversion: 2.1 time: 0.583272 Dec 15 19:08:23.989725 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 470/896] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:08:23 2021] DELETE /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/os-volume_attachments/ea99973f-7ebc-46dd-98f6-ed296c585a38 => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:08:24.528809 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Flavor limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:08:24.529746 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Image limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:08:24.530364 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Flavor pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:08:24.531560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Image pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:08:24.532080 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:08:24.560942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:24.561422 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:24.562239 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:24.562676 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:24.592124 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:08:24.596851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Getting quotas for user 497f05dbb53e48a38abf9529018d1766 and project 9d8cea93eb6c4a0d90f0c234dbef38f7. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:08:24.610432 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Going to run 1 instances... {{(pid=116515) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:08:24.614330 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:08:24.824077 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-159ab8db-9329-4916-b228-c1b1e6adef86 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.129156 Dec 15 19:08:24.831872 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 427/897] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Dec 15 19:08:23 2021] POST /compute/v2.1/servers => generated 402 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 19:08:24.838465 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6228f9bb-7798-4a63-ae8b-50961b3a0672 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:24.839332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6228f9bb-7798-4a63-ae8b-50961b3a0672 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:24.942208 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6228f9bb-7798-4a63-ae8b-50961b3a0672 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:24.950087 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6228f9bb-7798-4a63-ae8b-50961b3a0672 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:24.956951 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6228f9bb-7798-4a63-ae8b-50961b3a0672 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:24.973934 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6228f9bb-7798-4a63-ae8b-50961b3a0672 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1282 microversion: 2.20 time: 0.127670 Dec 15 19:08:24.978420 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 471/898] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:24 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:08:25.249559 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-79174c71-fb2a-4998-94b5-1010b55107b7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:25.260034 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-79174c71-fb2a-4998-94b5-1010b55107b7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:25.260495 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-79174c71-fb2a-4998-94b5-1010b55107b7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:25.285634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-79174c71-fb2a-4998-94b5-1010b55107b7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Going to try to stop instance {{(pid=116515) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 19:08:25.545857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-79174c71-fb2a-4998-94b5-1010b55107b7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 202 len: 0 microversion: 2.1 time: 0.300111 Dec 15 19:08:25.549230 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 428/899] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:08:25 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:08:25.554630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-afb04133-024b-4643-852b-90e5bb85c576 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:25.555246 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-afb04133-024b-4643-852b-90e5bb85c576 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:25.561969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afb04133-024b-4643-852b-90e5bb85c576 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:25.562419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afb04133-024b-4643-852b-90e5bb85c576 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:25.563309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afb04133-024b-4643-852b-90e5bb85c576 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:25.563730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afb04133-024b-4643-852b-90e5bb85c576 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:25.702627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-afb04133-024b-4643-852b-90e5bb85c576 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:25.715183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-afb04133-024b-4643-852b-90e5bb85c576 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1676 microversion: 2.1 time: 0.164269 Dec 15 19:08:25.716560 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 472/900] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:25 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:25.997241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0b65edff-d92e-43a8-9e45-4d41f2fad6a4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:26.001454 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0b65edff-d92e-43a8-9e45-4d41f2fad6a4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:26.323827 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0b65edff-d92e-43a8-9e45-4d41f2fad6a4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:26.332299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0b65edff-d92e-43a8-9e45-4d41f2fad6a4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:26.333964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0b65edff-d92e-43a8-9e45-4d41f2fad6a4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:26.335568 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0b65edff-d92e-43a8-9e45-4d41f2fad6a4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1282 microversion: 2.20 time: 0.342995 Dec 15 19:08:26.346872 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 429/901] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:25 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1282 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:26.739565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-457e1e74-4941-4fd6-8473-96ec7844247c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:26.740190 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-457e1e74-4941-4fd6-8473-96ec7844247c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:26.751597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-457e1e74-4941-4fd6-8473-96ec7844247c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:26.754792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-457e1e74-4941-4fd6-8473-96ec7844247c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:26.754792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-457e1e74-4941-4fd6-8473-96ec7844247c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:26.754792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-457e1e74-4941-4fd6-8473-96ec7844247c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:26.926266 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-457e1e74-4941-4fd6-8473-96ec7844247c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:26.936189 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-457e1e74-4941-4fd6-8473-96ec7844247c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1676 microversion: 2.1 time: 0.207973 Dec 15 19:08:26.937335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 473/902] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:26 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:27.357563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:27.363542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:27.368073 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:27.368640 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:27.369918 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:27.370473 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:27.490247 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:27.512843 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:27.515222 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:27.517546 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-05e1cdc9-1a66-40ca-b04c-2db8a1c47b36 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1342 microversion: 2.20 time: 0.167487 Dec 15 19:08:27.523511 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 430/903] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:27 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:27.955054 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6de54868-3c0c-42f3-a463-d87f48258d2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:27.955658 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6de54868-3c0c-42f3-a463-d87f48258d2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:27.964041 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6de54868-3c0c-42f3-a463-d87f48258d2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:27.966333 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6de54868-3c0c-42f3-a463-d87f48258d2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:27.968948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6de54868-3c0c-42f3-a463-d87f48258d2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:27.969681 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6de54868-3c0c-42f3-a463-d87f48258d2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:28.297678 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6de54868-3c0c-42f3-a463-d87f48258d2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:28.310055 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6de54868-3c0c-42f3-a463-d87f48258d2c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1676 microversion: 2.1 time: 0.358985 Dec 15 19:08:28.314579 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 474/904] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:27 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1676 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:28.543221 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:28.544445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:28.553058 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:28.553694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:28.554716 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:28.555160 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:29.195974 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:29.206981 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:29.210496 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:29.214266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-55d1c317-2ef8-432c-a0ba-4b9f9c880020 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1408 microversion: 2.20 time: 0.675198 Dec 15 19:08:29.229748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 431/905] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:28 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1408 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:29.329393 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f3d6ba3f-ed5b-42ce-8f75-126c41be6ba7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:29.330817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f3d6ba3f-ed5b-42ce-8f75-126c41be6ba7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:29.344474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f3d6ba3f-ed5b-42ce-8f75-126c41be6ba7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:29.345837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f3d6ba3f-ed5b-42ce-8f75-126c41be6ba7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:29.347253 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f3d6ba3f-ed5b-42ce-8f75-126c41be6ba7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:29.350930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f3d6ba3f-ed5b-42ce-8f75-126c41be6ba7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:29.939784 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-943839df-fafa-4e26-8df5-8ce55f880e62 req-8811bd55-32ec-41e0-ad87-19356ea0508b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8ea341-62ac-42cb-8ae6-b14554543d64", "tag": "b365bf51-9207-425f-b345-4f76d1e37689"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:29.942976 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:08:29.942976 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:08:29.965435 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-943839df-fafa-4e26-8df5-8ce55f880e62 req-8811bd55-32ec-41e0-ad87-19356ea0508b service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:29.965886 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-943839df-fafa-4e26-8df5-8ce55f880e62 req-8811bd55-32ec-41e0-ad87-19356ea0508b service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:29.987300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-943839df-fafa-4e26-8df5-8ce55f880e62 req-8811bd55-32ec-41e0-ad87-19356ea0508b service nova] Creating event network-changed:b365bf51-9207-425f-b345-4f76d1e37689 for instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 on hv-cinder-81268 Dec 15 19:08:29.997161 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f3d6ba3f-ed5b-42ce-8f75-126c41be6ba7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:29.997697 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-943839df-fafa-4e26-8df5-8ce55f880e62 req-8811bd55-32ec-41e0-ad87-19356ea0508b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065716 Dec 15 19:08:29.998873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 432/906] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:08:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:08:30.015704 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f3d6ba3f-ed5b-42ce-8f75-126c41be6ba7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1676 microversion: 2.1 time: 0.684661 Dec 15 19:08:30.026237 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 475/907] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:29 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1676 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:30.236553 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:30.237450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:30.243846 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:30.244299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:30.245129 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:30.245556 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:30.597594 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:30.613795 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:30.616857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:30.619701 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0d7a69c3-3b80-4177-a570-df744f39ef68 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1408 microversion: 2.20 time: 0.387444 Dec 15 19:08:30.621361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 433/908] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:30 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1408 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:31.036350 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-676767b0-8709-4e10-b83c-55e1e65fb1ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:31.037626 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-676767b0-8709-4e10-b83c-55e1e65fb1ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:31.046598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-676767b0-8709-4e10-b83c-55e1e65fb1ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:31.047236 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-676767b0-8709-4e10-b83c-55e1e65fb1ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:31.051142 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-676767b0-8709-4e10-b83c-55e1e65fb1ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:31.053073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-676767b0-8709-4e10-b83c-55e1e65fb1ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:31.375918 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-676767b0-8709-4e10-b83c-55e1e65fb1ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:31.384637 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-676767b0-8709-4e10-b83c-55e1e65fb1ae tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1676 microversion: 2.1 time: 0.354524 Dec 15 19:08:31.395367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 476/909] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:31 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1676 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:31.640212 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:31.641045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:31.649043 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:31.654183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:31.654183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:31.654183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:31.866648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:31.875463 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:31.877319 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:31.879252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8c860562-2f37-41a6-a57c-787807856fc2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1408 microversion: 2.20 time: 0.243484 Dec 15 19:08:31.879801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 434/910] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:31 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:32.403625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c9564f67-3108-452f-aeec-5068652ee18f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:32.405691 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c9564f67-3108-452f-aeec-5068652ee18f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:32.414474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c9564f67-3108-452f-aeec-5068652ee18f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:32.415303 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c9564f67-3108-452f-aeec-5068652ee18f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:32.426593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c9564f67-3108-452f-aeec-5068652ee18f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:32.427297 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c9564f67-3108-452f-aeec-5068652ee18f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:32.660927 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c9564f67-3108-452f-aeec-5068652ee18f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:32.671026 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c9564f67-3108-452f-aeec-5068652ee18f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1676 microversion: 2.1 time: 0.272370 Dec 15 19:08:32.671698 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 477/911] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:32 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1676 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:32.898090 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:32.899228 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:32.910586 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:32.911038 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:32.913049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:32.913509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:33.126171 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:33.135453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:33.137291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:33.138813 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b61ea63c-7b03-4a0e-9abe-c67a83077bca tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1408 microversion: 2.20 time: 0.245703 Dec 15 19:08:33.139628 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 435/912] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:32 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:33.687841 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e538f93a-9847-4a72-92e1-226e5338d2a7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:33.688446 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e538f93a-9847-4a72-92e1-226e5338d2a7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:33.695481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e538f93a-9847-4a72-92e1-226e5338d2a7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:33.695908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e538f93a-9847-4a72-92e1-226e5338d2a7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:33.696736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e538f93a-9847-4a72-92e1-226e5338d2a7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:33.697194 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e538f93a-9847-4a72-92e1-226e5338d2a7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:33.854437 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e538f93a-9847-4a72-92e1-226e5338d2a7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:33.862971 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e538f93a-9847-4a72-92e1-226e5338d2a7 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1676 microversion: 2.1 time: 0.178861 Dec 15 19:08:33.866244 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 478/913] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:33 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:34.157404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:34.160505 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:34.190721 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:34.191933 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:34.192778 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:34.193263 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:34.371074 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:34.385166 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:34.387647 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:34.389852 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0212c4dc-886c-41f6-a5e7-e68806d9ceef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1408 microversion: 2.20 time: 0.236579 Dec 15 19:08:34.391274 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 436/914] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:34 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:34.882282 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-51df7e85-af13-4bc5-8eb4-f27ea3bb30e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:34.883674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-51df7e85-af13-4bc5-8eb4-f27ea3bb30e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:34.893898 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-51df7e85-af13-4bc5-8eb4-f27ea3bb30e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:34.894694 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-51df7e85-af13-4bc5-8eb4-f27ea3bb30e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:34.896241 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-51df7e85-af13-4bc5-8eb4-f27ea3bb30e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:34.897235 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-51df7e85-af13-4bc5-8eb4-f27ea3bb30e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:35.101723 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-51df7e85-af13-4bc5-8eb4-f27ea3bb30e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:35.109601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-51df7e85-af13-4bc5-8eb4-f27ea3bb30e9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1676 microversion: 2.1 time: 0.232547 Dec 15 19:08:35.119627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 479/915] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:34 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1676 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:35.408674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:35.409994 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:35.422678 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-d0376fa6-6bc5-4628-8870-950e9421fb3e req-b1e5f25b-dfc3-42f4-a272-2a9eb55cc47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8ea341-62ac-42cb-8ae6-b14554543d64", "name": "network-vif-plugged", "status": "completed", "tag": "b365bf51-9207-425f-b345-4f76d1e37689"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:35.425292 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:08:35.425292 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:08:35.433830 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:35.436271 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:35.438147 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:35.441161 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-d0376fa6-6bc5-4628-8870-950e9421fb3e req-b1e5f25b-dfc3-42f4-a272-2a9eb55cc47f service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:35.442456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:35.446201 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-d0376fa6-6bc5-4628-8870-950e9421fb3e req-b1e5f25b-dfc3-42f4-a272-2a9eb55cc47f service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:35.490746 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-d0376fa6-6bc5-4628-8870-950e9421fb3e req-b1e5f25b-dfc3-42f4-a272-2a9eb55cc47f service nova] Creating event network-vif-plugged:b365bf51-9207-425f-b345-4f76d1e37689 for instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 on hv-cinder-81268 Dec 15 19:08:35.498290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-d0376fa6-6bc5-4628-8870-950e9421fb3e req-b1e5f25b-dfc3-42f4-a272-2a9eb55cc47f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078496 Dec 15 19:08:35.499428 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 480/916] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:08:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:08:35.681924 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:35.694213 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:35.696662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:35.698818 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fddd55ee-02f8-41a7-8fc7-cefa4ea223e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1408 microversion: 2.20 time: 0.294578 Dec 15 19:08:35.699836 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 437/917] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:35 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1408 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:36.128615 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2823db3a-3f04-40e4-ac62-0a84b9af4e60 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:36.132000 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2823db3a-3f04-40e4-ac62-0a84b9af4e60 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:36.144729 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2823db3a-3f04-40e4-ac62-0a84b9af4e60 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:36.145363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2823db3a-3f04-40e4-ac62-0a84b9af4e60 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:36.148556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2823db3a-3f04-40e4-ac62-0a84b9af4e60 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:36.149121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2823db3a-3f04-40e4-ac62-0a84b9af4e60 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:36.340250 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2823db3a-3f04-40e4-ac62-0a84b9af4e60 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:36.350639 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2823db3a-3f04-40e4-ac62-0a84b9af4e60 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1653 microversion: 2.1 time: 0.226809 Dec 15 19:08:36.363623 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 481/918] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:36 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1653 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:36.370226 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-20b920d5-052c-4660-9ca9-9c6fdf72e050 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:36.379080 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-20b920d5-052c-4660-9ca9-9c6fdf72e050 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:36.380309 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-20b920d5-052c-4660-9ca9-9c6fdf72e050 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:36.414195 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-20b920d5-052c-4660-9ca9-9c6fdf72e050 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Going to try to start instance {{(pid=116515) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 19:08:36.618926 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-20b920d5-052c-4660-9ca9-9c6fdf72e050 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action" status: 202 len: 0 microversion: 2.1 time: 0.253192 Dec 15 19:08:36.620171 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 438/919] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:08:36 2021] POST /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:08:36.629836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-88cc18f1-fbd6-459e-927d-dbc34f342e50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:36.631004 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-88cc18f1-fbd6-459e-927d-dbc34f342e50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:36.639211 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-88cc18f1-fbd6-459e-927d-dbc34f342e50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:36.642754 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-88cc18f1-fbd6-459e-927d-dbc34f342e50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:36.647736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-88cc18f1-fbd6-459e-927d-dbc34f342e50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:36.648495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-88cc18f1-fbd6-459e-927d-dbc34f342e50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:36.721755 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:36.725847 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:36.746262 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:36.748882 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:36.760035 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:36.766349 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:36.900560 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-88cc18f1-fbd6-459e-927d-dbc34f342e50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:36.908366 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-88cc18f1-fbd6-459e-927d-dbc34f342e50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1662 microversion: 2.1 time: 0.283840 Dec 15 19:08:36.920055 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 482/920] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:36 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1662 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:37.203774 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:37.232129 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:37.233767 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:37.239335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b96d073e-3bac-4588-96c7-1407dcd64a9e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1408 microversion: 2.20 time: 0.524147 Dec 15 19:08:37.264979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 439/921] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:36 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1408 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:37.932069 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-895a796d-70db-4c68-b0d3-a0ef2c4cc41b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:37.934039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-895a796d-70db-4c68-b0d3-a0ef2c4cc41b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:37.942124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-895a796d-70db-4c68-b0d3-a0ef2c4cc41b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:37.942694 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-895a796d-70db-4c68-b0d3-a0ef2c4cc41b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:37.946243 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-895a796d-70db-4c68-b0d3-a0ef2c4cc41b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:37.946943 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-895a796d-70db-4c68-b0d3-a0ef2c4cc41b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:38.168331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-895a796d-70db-4c68-b0d3-a0ef2c4cc41b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:38.176664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-895a796d-70db-4c68-b0d3-a0ef2c4cc41b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1662 microversion: 2.1 time: 0.250486 Dec 15 19:08:38.179288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 483/922] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:37 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1662 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:38.265317 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:38.266023 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:38.272929 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:38.273420 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:38.274233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:38.274675 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:38.462992 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:38.474304 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:38.475877 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:38.477071 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7a28a9da-1c37-4c19-aec8-546be6bdf743 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1600 microversion: 2.20 time: 0.218789 Dec 15 19:08:38.477670 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 440/923] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:08:38 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:08:38.495451 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-81a20b2c-1bcb-4736-baa7-60bb9cd94bb1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:38.495979 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-81a20b2c-1bcb-4736-baa7-60bb9cd94bb1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:38.502843 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-81a20b2c-1bcb-4736-baa7-60bb9cd94bb1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:38.503329 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-81a20b2c-1bcb-4736-baa7-60bb9cd94bb1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:38.504136 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-81a20b2c-1bcb-4736-baa7-60bb9cd94bb1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:38.504572 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-81a20b2c-1bcb-4736-baa7-60bb9cd94bb1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:38.596931 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-81a20b2c-1bcb-4736-baa7-60bb9cd94bb1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.105060 Dec 15 19:08:38.597567 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 484/924] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Dec 15 19:08:38 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:08:39.195557 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ddcad3c6-3149-4f2b-b761-3ea728edc9ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:39.196344 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ddcad3c6-3149-4f2b-b761-3ea728edc9ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:39.214245 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ddcad3c6-3149-4f2b-b761-3ea728edc9ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:39.214245 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ddcad3c6-3149-4f2b-b761-3ea728edc9ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:39.214245 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ddcad3c6-3149-4f2b-b761-3ea728edc9ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:39.214245 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ddcad3c6-3149-4f2b-b761-3ea728edc9ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:39.405855 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ddcad3c6-3149-4f2b-b761-3ea728edc9ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:39.415670 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ddcad3c6-3149-4f2b-b761-3ea728edc9ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1666 microversion: 2.1 time: 0.224161 Dec 15 19:08:39.417056 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 441/925] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:39 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1666 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:39.922849 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-f700c4c8-c938-40c4-81ba-110c894b6796 req-8562c292-5b5a-4936-9242-fce32ca5cc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8ea341-62ac-42cb-8ae6-b14554543d64", "tag": "b365bf51-9207-425f-b345-4f76d1e37689"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:39.924303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:08:39.924303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:08:39.940355 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-f700c4c8-c938-40c4-81ba-110c894b6796 req-8562c292-5b5a-4936-9242-fce32ca5cc26 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:39.941779 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-f700c4c8-c938-40c4-81ba-110c894b6796 req-8562c292-5b5a-4936-9242-fce32ca5cc26 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:39.961288 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-f700c4c8-c938-40c4-81ba-110c894b6796 req-8562c292-5b5a-4936-9242-fce32ca5cc26 service nova] Creating event network-changed:b365bf51-9207-425f-b345-4f76d1e37689 for instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 on hv-cinder-81268 Dec 15 19:08:39.967648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-f700c4c8-c938-40c4-81ba-110c894b6796 req-8562c292-5b5a-4936-9242-fce32ca5cc26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048355 Dec 15 19:08:39.969058 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 442/926] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:08:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:08:40.183214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-41dd4f1f-0cef-4861-a2fe-9f1d053e27d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:40.184914 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-41dd4f1f-0cef-4861-a2fe-9f1d053e27d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:40.202284 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-41dd4f1f-0cef-4861-a2fe-9f1d053e27d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:40.203929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-41dd4f1f-0cef-4861-a2fe-9f1d053e27d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:40.204848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-41dd4f1f-0cef-4861-a2fe-9f1d053e27d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:40.207619 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-41dd4f1f-0cef-4861-a2fe-9f1d053e27d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:40.301424 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-41dd4f1f-0cef-4861-a2fe-9f1d053e27d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 14 microversion: 2.20 time: 0.400651 Dec 15 19:08:40.305282 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 485/927] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:39 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 14 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:41.315614 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-60b5b29f-5d80-4326-ad9a-7578752c9a6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:41.317693 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-60b5b29f-5d80-4326-ad9a-7578752c9a6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:41.326162 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-60b5b29f-5d80-4326-ad9a-7578752c9a6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:41.330639 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-60b5b29f-5d80-4326-ad9a-7578752c9a6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:41.331802 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-60b5b29f-5d80-4326-ad9a-7578752c9a6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:41.332460 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-60b5b29f-5d80-4326-ad9a-7578752c9a6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:41.426170 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-60b5b29f-5d80-4326-ad9a-7578752c9a6e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 14 microversion: 2.20 time: 0.117233 Dec 15 19:08:41.429749 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 443/928] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:41 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:42.440831 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-cbc401f2-586a-42a7-8289-40fae756a6e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:42.442532 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-cbc401f2-586a-42a7-8289-40fae756a6e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:42.450190 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cbc401f2-586a-42a7-8289-40fae756a6e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:42.450641 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cbc401f2-586a-42a7-8289-40fae756a6e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:42.451432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cbc401f2-586a-42a7-8289-40fae756a6e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:42.451864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cbc401f2-586a-42a7-8289-40fae756a6e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:42.509408 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-cbc401f2-586a-42a7-8289-40fae756a6e8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 14 microversion: 2.20 time: 0.075901 Dec 15 19:08:42.510067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 486/929] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:42 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:43.522002 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3abbd27f-f56f-4f82-b761-d44b6df68b03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:43.523204 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3abbd27f-f56f-4f82-b761-d44b6df68b03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:43.531458 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3abbd27f-f56f-4f82-b761-d44b6df68b03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:43.532253 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3abbd27f-f56f-4f82-b761-d44b6df68b03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:43.533598 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3abbd27f-f56f-4f82-b761-d44b6df68b03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:43.534103 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3abbd27f-f56f-4f82-b761-d44b6df68b03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:43.593891 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3abbd27f-f56f-4f82-b761-d44b6df68b03 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 14 microversion: 2.20 time: 0.076781 Dec 15 19:08:43.597351 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 444/930] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:43 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:44.606593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-96d7977e-9866-4e06-accb-1acf8605d30c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:44.608212 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-96d7977e-9866-4e06-accb-1acf8605d30c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:44.620596 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-96d7977e-9866-4e06-accb-1acf8605d30c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:44.621045 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-96d7977e-9866-4e06-accb-1acf8605d30c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:44.621878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-96d7977e-9866-4e06-accb-1acf8605d30c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:44.625402 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-96d7977e-9866-4e06-accb-1acf8605d30c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:44.685854 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-96d7977e-9866-4e06-accb-1acf8605d30c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 14 microversion: 2.20 time: 0.084114 Dec 15 19:08:44.689793 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 487/931] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:44 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:45.698349 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a1b974e6-7785-46af-9cc2-385cb70c8211 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:45.699373 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a1b974e6-7785-46af-9cc2-385cb70c8211 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:45.710996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a1b974e6-7785-46af-9cc2-385cb70c8211 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:45.710996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a1b974e6-7785-46af-9cc2-385cb70c8211 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:45.710996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a1b974e6-7785-46af-9cc2-385cb70c8211 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:45.710996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a1b974e6-7785-46af-9cc2-385cb70c8211 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:45.768997 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a1b974e6-7785-46af-9cc2-385cb70c8211 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 14 microversion: 2.20 time: 0.075021 Dec 15 19:08:45.769651 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 445/932] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:45 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:46.708022 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-09e1fe0e-a3b6-413b-869a-1179a3a0b7b3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Action: 'create', calling method: .version_select at 0x7f80b61338b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2060691409"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:46.726949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-09e1fe0e-a3b6-413b-869a-1179a3a0b7b3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Getting quotas for project 5df652172dff4ee08b4dddf7a40b0142. Resources: {'key_pairs'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:08:46.731166 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-09e1fe0e-a3b6-413b-869a-1179a3a0b7b3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Getting quotas for user 473179fd6af84654a68376d17726b662 and project 5df652172dff4ee08b4dddf7a40b0142. Resources: {'key_pairs'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:08:46.780070 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e2c44ef0-2285-44c7-bd8f-a315d2853b48 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:46.781070 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e2c44ef0-2285-44c7-bd8f-a315d2853b48 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:46.788401 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e2c44ef0-2285-44c7-bd8f-a315d2853b48 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:46.788864 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e2c44ef0-2285-44c7-bd8f-a315d2853b48 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:46.789659 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e2c44ef0-2285-44c7-bd8f-a315d2853b48 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:46.790099 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e2c44ef0-2285-44c7-bd8f-a315d2853b48 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:46.854281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e2c44ef0-2285-44c7-bd8f-a315d2853b48 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 14 microversion: 2.20 time: 0.078150 Dec 15 19:08:46.854950 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 446/933] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:46 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:46.998833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-09e1fe0e-a3b6-413b-869a-1179a3a0b7b3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Getting quotas for project 5df652172dff4ee08b4dddf7a40b0142. Resources: {'key_pairs'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:08:47.003060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-09e1fe0e-a3b6-413b-869a-1179a3a0b7b3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Getting quotas for user 473179fd6af84654a68376d17726b662 and project 5df652172dff4ee08b4dddf7a40b0142. Resources: {'key_pairs'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:08:47.015630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-09e1fe0e-a3b6-413b-869a-1179a3a0b7b3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.312281 Dec 15 19:08:47.016233 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 488/934] 10.222.0.49 () {60 vars in 1157 bytes} [Wed Dec 15 19:08:46 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:47.109193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1636065356", "imageRef": "28d6da63-9245-401f-ba44-1eac1ce87c42", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2060691409", "networks": [{"uuid": "f8498b13-b8e7-458b-9a53-2a5bad9da27f"}]}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:47.159614 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.network.neutron [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] validate_networks() for [('f8498b13-b8e7-458b-9a53-2a5bad9da27f', None, None, None, None, None)] {{(pid=116515) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:08:47.621031 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Flavor limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:08:47.621482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Image limits 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:08:47.622213 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Flavor pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:08:47.622618 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Image pref 0:0:0 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:08:47.623027 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.virt.hardware [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:08:47.631564 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:47.632012 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:47.632821 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:47.633299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:47.649471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Getting quotas for project 5df652172dff4ee08b4dddf7a40b0142. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:08:47.653474 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Getting quotas for user 473179fd6af84654a68376d17726b662 and project 5df652172dff4ee08b4dddf7a40b0142. Resources: {'instances', 'ram', 'cores'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:08:47.664589 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Going to run 1 instances... {{(pid=116515) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:08:47.666942 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='28d6da63-9245-401f-ba44-1eac1ce87c42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:08:47.800639 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-35a9b1b1-f786-4860-850d-2ac457e62fe9 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695380 Dec 15 19:08:47.801565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 447/935] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:08:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:08:47.811995 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-01a89fb8-44e4-43b7-b8d4-28844f4536a2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:47.813466 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-01a89fb8-44e4-43b7-b8d4-28844f4536a2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:47.864676 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-52800d49-e45c-4d37-9a82-a86806ed19b3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:47.865889 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-52800d49-e45c-4d37-9a82-a86806ed19b3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:47.878002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-01a89fb8-44e4-43b7-b8d4-28844f4536a2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:47.882253 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-52800d49-e45c-4d37-9a82-a86806ed19b3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:47.882253 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-52800d49-e45c-4d37-9a82-a86806ed19b3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:47.882253 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-52800d49-e45c-4d37-9a82-a86806ed19b3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:47.882253 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-52800d49-e45c-4d37-9a82-a86806ed19b3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:47.889275 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-01a89fb8-44e4-43b7-b8d4-28844f4536a2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1259 microversion: 2.1 time: 0.081925 Dec 15 19:08:47.890626 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 489/936] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:47 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1259 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:47.944973 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-52800d49-e45c-4d37-9a82-a86806ed19b3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 14 microversion: 2.20 time: 0.084316 Dec 15 19:08:47.946881 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 448/937] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:47 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:48.907370 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1c773d27-9508-43a2-ae08-a75cbe203875 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:48.907980 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1c773d27-9508-43a2-ae08-a75cbe203875 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:48.959587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1c773d27-9508-43a2-ae08-a75cbe203875 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:48.960280 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b48f4c28-9c09-4faa-ba2f-8042142a4194 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:48.961322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b48f4c28-9c09-4faa-ba2f-8042142a4194 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:48.967893 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b48f4c28-9c09-4faa-ba2f-8042142a4194 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:48.968219 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1c773d27-9508-43a2-ae08-a75cbe203875 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1259 microversion: 2.1 time: 0.064451 Dec 15 19:08:48.968331 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b48f4c28-9c09-4faa-ba2f-8042142a4194 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:48.975934 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b48f4c28-9c09-4faa-ba2f-8042142a4194 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:48.976174 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 490/938] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:48 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:48.976256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b48f4c28-9c09-4faa-ba2f-8042142a4194 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:49.037406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b48f4c28-9c09-4faa-ba2f-8042142a4194 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 14 microversion: 2.20 time: 0.082568 Dec 15 19:08:49.038168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 449/939] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:48 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:49.985238 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-919bfc21-64a0-4da5-b56d-c3955f6d0677 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:49.985769 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-919bfc21-64a0-4da5-b56d-c3955f6d0677 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:49.992825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-919bfc21-64a0-4da5-b56d-c3955f6d0677 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:49.993318 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-919bfc21-64a0-4da5-b56d-c3955f6d0677 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:49.994093 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-919bfc21-64a0-4da5-b56d-c3955f6d0677 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:49.994528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-919bfc21-64a0-4da5-b56d-c3955f6d0677 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:50.048643 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4c57f76e-7497-4d53-b5d5-182f740cacb4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:50.049789 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4c57f76e-7497-4d53-b5d5-182f740cacb4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:50.056688 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c57f76e-7497-4d53-b5d5-182f740cacb4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:50.059253 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c57f76e-7497-4d53-b5d5-182f740cacb4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:50.059368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-919bfc21-64a0-4da5-b56d-c3955f6d0677 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:50.059500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c57f76e-7497-4d53-b5d5-182f740cacb4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:50.059500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c57f76e-7497-4d53-b5d5-182f740cacb4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:50.065230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-919bfc21-64a0-4da5-b56d-c3955f6d0677 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1311 microversion: 2.1 time: 0.083742 Dec 15 19:08:50.065801 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 491/940] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:49 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:50.148985 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4c57f76e-7497-4d53-b5d5-182f740cacb4 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 11629 microversion: 2.20 time: 0.104458 Dec 15 19:08:50.149904 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 450/941] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:50 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 11629 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:08:51.082623 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-868d8c5e-90db-47f7-a18b-f5c1a2303f6c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:51.083859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-868d8c5e-90db-47f7-a18b-f5c1a2303f6c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:51.092041 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-868d8c5e-90db-47f7-a18b-f5c1a2303f6c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:51.092342 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-868d8c5e-90db-47f7-a18b-f5c1a2303f6c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:51.093149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-868d8c5e-90db-47f7-a18b-f5c1a2303f6c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:51.093584 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-868d8c5e-90db-47f7-a18b-f5c1a2303f6c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:51.162867 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-39ddc6ae-4dfb-42e4-99e7-4b4487e0475e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:08:51.164607 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-39ddc6ae-4dfb-42e4-99e7-4b4487e0475e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:51.172344 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-39ddc6ae-4dfb-42e4-99e7-4b4487e0475e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:51.173973 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-39ddc6ae-4dfb-42e4-99e7-4b4487e0475e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:51.175049 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-39ddc6ae-4dfb-42e4-99e7-4b4487e0475e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:51.175732 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-39ddc6ae-4dfb-42e4-99e7-4b4487e0475e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:51.357007 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-868d8c5e-90db-47f7-a18b-f5c1a2303f6c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:51.364980 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-868d8c5e-90db-47f7-a18b-f5c1a2303f6c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.286165 Dec 15 19:08:51.365628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 492/942] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:51 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:52.382296 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-79846825-954b-49f3-a8ed-a26074649009 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:52.383033 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-79846825-954b-49f3-a8ed-a26074649009 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:52.389375 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79846825-954b-49f3-a8ed-a26074649009 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:52.389827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79846825-954b-49f3-a8ed-a26074649009 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:52.390620 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79846825-954b-49f3-a8ed-a26074649009 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:52.391063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-79846825-954b-49f3-a8ed-a26074649009 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:52.535498 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-79846825-954b-49f3-a8ed-a26074649009 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:52.543686 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-79846825-954b-49f3-a8ed-a26074649009 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.164976 Dec 15 19:08:52.544501 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 493/943] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:52 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:53.561588 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5fb6dbd1-2aad-4687-addd-1693a78f1792 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:53.562376 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5fb6dbd1-2aad-4687-addd-1693a78f1792 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:53.569469 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5fb6dbd1-2aad-4687-addd-1693a78f1792 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:53.569943 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5fb6dbd1-2aad-4687-addd-1693a78f1792 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:53.570717 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5fb6dbd1-2aad-4687-addd-1693a78f1792 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:53.571143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5fb6dbd1-2aad-4687-addd-1693a78f1792 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:53.721039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-5fb6dbd1-2aad-4687-addd-1693a78f1792 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:53.732915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5fb6dbd1-2aad-4687-addd-1693a78f1792 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.175638 Dec 15 19:08:53.733549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 494/944] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:53 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:08:54.750641 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-90478037-6938-4ebe-b61b-efdab2dadf34 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:54.751932 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-90478037-6938-4ebe-b61b-efdab2dadf34 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:54.758595 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-90478037-6938-4ebe-b61b-efdab2dadf34 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:54.759293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-90478037-6938-4ebe-b61b-efdab2dadf34 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:54.760090 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-90478037-6938-4ebe-b61b-efdab2dadf34 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:54.760529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-90478037-6938-4ebe-b61b-efdab2dadf34 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:54.906279 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-90478037-6938-4ebe-b61b-efdab2dadf34 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:54.914556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-90478037-6938-4ebe-b61b-efdab2dadf34 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.167963 Dec 15 19:08:54.915749 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 495/945] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:54 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:55.932365 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9b97fc24-4e79-433c-92cf-2d3a0d0979d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:55.933044 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9b97fc24-4e79-433c-92cf-2d3a0d0979d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:55.940028 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9b97fc24-4e79-433c-92cf-2d3a0d0979d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:55.940510 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9b97fc24-4e79-433c-92cf-2d3a0d0979d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:55.941406 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9b97fc24-4e79-433c-92cf-2d3a0d0979d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:55.941844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9b97fc24-4e79-433c-92cf-2d3a0d0979d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:56.085448 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9b97fc24-4e79-433c-92cf-2d3a0d0979d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:56.092852 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9b97fc24-4e79-433c-92cf-2d3a0d0979d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.164149 Dec 15 19:08:56.093484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 496/946] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:55 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:57.110735 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6aec7d58-7309-4ba5-9e10-8e1fd286f428 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:57.112200 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6aec7d58-7309-4ba5-9e10-8e1fd286f428 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:57.118773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6aec7d58-7309-4ba5-9e10-8e1fd286f428 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:57.119431 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6aec7d58-7309-4ba5-9e10-8e1fd286f428 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:57.120404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6aec7d58-7309-4ba5-9e10-8e1fd286f428 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:57.121002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6aec7d58-7309-4ba5-9e10-8e1fd286f428 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:57.268309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6aec7d58-7309-4ba5-9e10-8e1fd286f428 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:57.275379 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6aec7d58-7309-4ba5-9e10-8e1fd286f428 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.168326 Dec 15 19:08:57.281919 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 497/947] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:57 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:58.296662 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-66a866dd-7207-4e2e-a431-5ed89a40b2a3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:58.300549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-66a866dd-7207-4e2e-a431-5ed89a40b2a3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:58.304489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-66a866dd-7207-4e2e-a431-5ed89a40b2a3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:58.304940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-66a866dd-7207-4e2e-a431-5ed89a40b2a3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:58.305748 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-66a866dd-7207-4e2e-a431-5ed89a40b2a3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:58.306178 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-66a866dd-7207-4e2e-a431-5ed89a40b2a3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:58.492875 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-66a866dd-7207-4e2e-a431-5ed89a40b2a3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:58.500823 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-66a866dd-7207-4e2e-a431-5ed89a40b2a3 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.207745 Dec 15 19:08:58.501456 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 498/948] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:58 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:08:59.519019 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-584155d8-716f-4ca0-81bf-14dde58178f6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:08:59.519680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-584155d8-716f-4ca0-81bf-14dde58178f6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:08:59.526151 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-584155d8-716f-4ca0-81bf-14dde58178f6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:59.526592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-584155d8-716f-4ca0-81bf-14dde58178f6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:59.527520 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-584155d8-716f-4ca0-81bf-14dde58178f6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:08:59.527804 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-584155d8-716f-4ca0-81bf-14dde58178f6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:08:59.672530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-584155d8-716f-4ca0-81bf-14dde58178f6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:08:59.681151 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-584155d8-716f-4ca0-81bf-14dde58178f6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.166219 Dec 15 19:08:59.681741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 499/949] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:08:59 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:00.698826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1750f555-5d65-4442-942b-318dfdb024fb tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:00.699507 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1750f555-5d65-4442-942b-318dfdb024fb tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:00.706339 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1750f555-5d65-4442-942b-318dfdb024fb tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:00.706791 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1750f555-5d65-4442-942b-318dfdb024fb tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:00.707587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1750f555-5d65-4442-942b-318dfdb024fb tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:00.708056 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1750f555-5d65-4442-942b-318dfdb024fb tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:00.847474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1750f555-5d65-4442-942b-318dfdb024fb tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:00.854911 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1750f555-5d65-4442-942b-318dfdb024fb tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.159883 Dec 15 19:09:00.863307 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 500/950] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:00 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:01.873487 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f3b6de8e-3307-4763-91aa-1068ee44683a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:01.874921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f3b6de8e-3307-4763-91aa-1068ee44683a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:01.882026 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f3b6de8e-3307-4763-91aa-1068ee44683a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:01.882475 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f3b6de8e-3307-4763-91aa-1068ee44683a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:01.883300 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f3b6de8e-3307-4763-91aa-1068ee44683a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:01.883736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f3b6de8e-3307-4763-91aa-1068ee44683a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:02.020902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f3b6de8e-3307-4763-91aa-1068ee44683a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:02.028619 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f3b6de8e-3307-4763-91aa-1068ee44683a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.159193 Dec 15 19:09:02.029221 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 501/951] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:01 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:02.811198 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-39ddc6ae-4dfb-42e4-99e7-4b4487e0475e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 28213 microversion: 2.20 time: 11.652869 Dec 15 19:09:02.815178 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 451/952] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:08:51 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 28213 bytes in 11655 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:03.046214 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fd11bc3b-0907-4f3d-84bc-388e5fcf5c91 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:03.046747 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fd11bc3b-0907-4f3d-84bc-388e5fcf5c91 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:03.053025 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fd11bc3b-0907-4f3d-84bc-388e5fcf5c91 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:03.053500 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fd11bc3b-0907-4f3d-84bc-388e5fcf5c91 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:03.054311 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fd11bc3b-0907-4f3d-84bc-388e5fcf5c91 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:03.054748 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fd11bc3b-0907-4f3d-84bc-388e5fcf5c91 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:03.184941 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fd11bc3b-0907-4f3d-84bc-388e5fcf5c91 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:03.193067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fd11bc3b-0907-4f3d-84bc-388e5fcf5c91 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.150587 Dec 15 19:09:03.196394 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 502/953] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:03 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:03.760580 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-98922893-e8c1-4df5-9818-c80b25054046 req-6ec8a9c8-992f-47e5-a511-131487182012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0c4ba6-607a-4213-adfc-22306c7c61bd", "tag": "b5f44d8c-08ee-4a4e-85f0-5c1829876e7e"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:03.762509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:03.762509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:09:03.771699 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-98922893-e8c1-4df5-9818-c80b25054046 req-6ec8a9c8-992f-47e5-a511-131487182012 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:03.772421 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-98922893-e8c1-4df5-9818-c80b25054046 req-6ec8a9c8-992f-47e5-a511-131487182012 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:03.783384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-98922893-e8c1-4df5-9818-c80b25054046 req-6ec8a9c8-992f-47e5-a511-131487182012 service nova] Creating event network-changed:b5f44d8c-08ee-4a4e-85f0-5c1829876e7e for instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd on hv-cinder-81268 Dec 15 19:09:03.788855 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-98922893-e8c1-4df5-9818-c80b25054046 req-6ec8a9c8-992f-47e5-a511-131487182012 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159439 Dec 15 19:09:03.789799 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 452/954] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:03.822899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0a2fe4f7-ab93-40ed-a5c3-ffd0193f18a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:03.823842 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0a2fe4f7-ab93-40ed-a5c3-ffd0193f18a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:03.830965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a2fe4f7-ab93-40ed-a5c3-ffd0193f18a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:03.831414 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a2fe4f7-ab93-40ed-a5c3-ffd0193f18a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:03.832197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a2fe4f7-ab93-40ed-a5c3-ffd0193f18a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:03.832629 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a2fe4f7-ab93-40ed-a5c3-ffd0193f18a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:03.909210 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0a2fe4f7-ab93-40ed-a5c3-ffd0193f18a7 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 28504 microversion: 2.20 time: 0.089797 Dec 15 19:09:03.910121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 503/955] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:03 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 28504 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:04.211524 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c2328144-4167-42b7-b313-5373c69467f0 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:04.212264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c2328144-4167-42b7-b313-5373c69467f0 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:04.218212 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2328144-4167-42b7-b313-5373c69467f0 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:04.218658 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2328144-4167-42b7-b313-5373c69467f0 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:04.219461 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2328144-4167-42b7-b313-5373c69467f0 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:04.219892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2328144-4167-42b7-b313-5373c69467f0 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:04.420862 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c2328144-4167-42b7-b313-5373c69467f0 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:04.428745 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c2328144-4167-42b7-b313-5373c69467f0 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.221685 Dec 15 19:09:04.429556 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 453/956] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:04 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:04.921495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-cf6a7b24-b735-4557-9d9e-a506b9e98cbc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:04.922439 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-cf6a7b24-b735-4557-9d9e-a506b9e98cbc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:04.929923 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf6a7b24-b735-4557-9d9e-a506b9e98cbc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:04.930401 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf6a7b24-b735-4557-9d9e-a506b9e98cbc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:04.931178 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf6a7b24-b735-4557-9d9e-a506b9e98cbc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:04.931639 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-cf6a7b24-b735-4557-9d9e-a506b9e98cbc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:05.016467 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-cf6a7b24-b735-4557-9d9e-a506b9e98cbc tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 28672 microversion: 2.20 time: 0.099132 Dec 15 19:09:05.017112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 504/957] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:04 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 28672 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:05.445676 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-80527439-1e57-42b2-a8f1-c4566e2da4dc tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:05.446220 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-80527439-1e57-42b2-a8f1-c4566e2da4dc tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:05.452486 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-80527439-1e57-42b2-a8f1-c4566e2da4dc tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:05.452941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-80527439-1e57-42b2-a8f1-c4566e2da4dc tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:05.453756 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-80527439-1e57-42b2-a8f1-c4566e2da4dc tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:05.454198 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-80527439-1e57-42b2-a8f1-c4566e2da4dc tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:05.587376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-80527439-1e57-42b2-a8f1-c4566e2da4dc tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:05.598844 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-80527439-1e57-42b2-a8f1-c4566e2da4dc tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.156971 Dec 15 19:09:05.599875 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 454/958] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:05 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:06.028874 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-05e7107b-eaf5-419b-a3fd-a989e88eb934 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:06.029889 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-05e7107b-eaf5-419b-a3fd-a989e88eb934 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:06.036748 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-05e7107b-eaf5-419b-a3fd-a989e88eb934 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:06.037230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-05e7107b-eaf5-419b-a3fd-a989e88eb934 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:06.038006 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-05e7107b-eaf5-419b-a3fd-a989e88eb934 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:06.038440 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-05e7107b-eaf5-419b-a3fd-a989e88eb934 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:06.099849 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-05e7107b-eaf5-419b-a3fd-a989e88eb934 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 28672 microversion: 2.20 time: 0.074936 Dec 15 19:09:06.100495 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 505/959] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:06 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 28672 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:06.615765 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-043b787e-4d90-4589-a912-d686701bbf58 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:06.616447 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-043b787e-4d90-4589-a912-d686701bbf58 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:06.623053 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-043b787e-4d90-4589-a912-d686701bbf58 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:06.623503 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-043b787e-4d90-4589-a912-d686701bbf58 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:06.624285 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-043b787e-4d90-4589-a912-d686701bbf58 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:06.624729 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-043b787e-4d90-4589-a912-d686701bbf58 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:06.768880 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-043b787e-4d90-4589-a912-d686701bbf58 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:06.776267 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-043b787e-4d90-4589-a912-d686701bbf58 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.164288 Dec 15 19:09:06.776838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 455/960] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:06 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:07.112185 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f5021cb4-04ba-4f1d-b4d7-a70f3e1d83a5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:07.113241 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f5021cb4-04ba-4f1d-b4d7-a70f3e1d83a5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:07.120102 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f5021cb4-04ba-4f1d-b4d7-a70f3e1d83a5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:07.120553 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f5021cb4-04ba-4f1d-b4d7-a70f3e1d83a5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:07.121648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f5021cb4-04ba-4f1d-b4d7-a70f3e1d83a5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:07.122082 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f5021cb4-04ba-4f1d-b4d7-a70f3e1d83a5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:07.188853 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f5021cb4-04ba-4f1d-b4d7-a70f3e1d83a5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 28672 microversion: 2.20 time: 0.080692 Dec 15 19:09:07.189506 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 506/961] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:07 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 28672 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:07.358797 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-3940c64a-cb85-46f4-a25c-8aca6107bb65 req-955ba288-6aba-43eb-8bf4-75a6a8201193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0c4ba6-607a-4213-adfc-22306c7c61bd", "name": "network-vif-plugged", "status": "completed", "tag": "b5f44d8c-08ee-4a4e-85f0-5c1829876e7e"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:07.360459 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:07.360459 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:09:07.370470 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-3940c64a-cb85-46f4-a25c-8aca6107bb65 req-955ba288-6aba-43eb-8bf4-75a6a8201193 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:07.371245 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-3940c64a-cb85-46f4-a25c-8aca6107bb65 req-955ba288-6aba-43eb-8bf4-75a6a8201193 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:07.384804 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-3940c64a-cb85-46f4-a25c-8aca6107bb65 req-955ba288-6aba-43eb-8bf4-75a6a8201193 service nova] Creating event network-vif-plugged:b5f44d8c-08ee-4a4e-85f0-5c1829876e7e for instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd on hv-cinder-81268 Dec 15 19:09:07.391097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-3940c64a-cb85-46f4-a25c-8aca6107bb65 req-955ba288-6aba-43eb-8bf4-75a6a8201193 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037766 Dec 15 19:09:07.391685 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 456/962] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:07.794181 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-28675f01-4588-4680-a491-ce8f06c0c3d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:07.794885 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-28675f01-4588-4680-a491-ce8f06c0c3d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:07.802056 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-28675f01-4588-4680-a491-ce8f06c0c3d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:07.802530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-28675f01-4588-4680-a491-ce8f06c0c3d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:07.803307 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-28675f01-4588-4680-a491-ce8f06c0c3d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:07.803740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-28675f01-4588-4680-a491-ce8f06c0c3d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:07.930811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-28675f01-4588-4680-a491-ce8f06c0c3d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:07.938467 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-28675f01-4588-4680-a491-ce8f06c0c3d1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1359 microversion: 2.1 time: 0.148136 Dec 15 19:09:07.939032 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 507/963] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:07 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:08.203858 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6a9146de-b60b-4880-bd89-0db24dedfd8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:08.204787 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6a9146de-b60b-4880-bd89-0db24dedfd8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:08.211489 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a9146de-b60b-4880-bd89-0db24dedfd8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:08.211936 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a9146de-b60b-4880-bd89-0db24dedfd8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:08.212718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a9146de-b60b-4880-bd89-0db24dedfd8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:08.213180 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a9146de-b60b-4880-bd89-0db24dedfd8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:08.290498 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6a9146de-b60b-4880-bd89-0db24dedfd8c tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 28791 microversion: 2.20 time: 0.091039 Dec 15 19:09:08.291144 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 457/964] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:08 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 28791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:09:08.955578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e178a6b6-48f7-43ec-96c7-e48341a38b80 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:08.956180 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e178a6b6-48f7-43ec-96c7-e48341a38b80 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:08.962586 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e178a6b6-48f7-43ec-96c7-e48341a38b80 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:08.963144 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e178a6b6-48f7-43ec-96c7-e48341a38b80 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:08.963883 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e178a6b6-48f7-43ec-96c7-e48341a38b80 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:08.964312 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e178a6b6-48f7-43ec-96c7-e48341a38b80 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:09.101845 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e178a6b6-48f7-43ec-96c7-e48341a38b80 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:09.109017 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e178a6b6-48f7-43ec-96c7-e48341a38b80 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1549 microversion: 2.1 time: 0.157317 Dec 15 19:09:09.109607 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 508/965] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:08 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:09.126235 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-cc12b3f5-5b47-4f4c-af28-65d4dc1eeafa tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:09.126936 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-cc12b3f5-5b47-4f4c-af28-65d4dc1eeafa tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:09.133689 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cc12b3f5-5b47-4f4c-af28-65d4dc1eeafa tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:09.134137 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cc12b3f5-5b47-4f4c-af28-65d4dc1eeafa tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:09.134909 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cc12b3f5-5b47-4f4c-af28-65d4dc1eeafa tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:09.135342 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cc12b3f5-5b47-4f4c-af28-65d4dc1eeafa tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:09.266524 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cc12b3f5-5b47-4f4c-af28-65d4dc1eeafa tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:09.273805 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-cc12b3f5-5b47-4f4c-af28-65d4dc1eeafa tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1549 microversion: 2.1 time: 0.151532 Dec 15 19:09:09.274360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 458/966] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:09 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:09.290209 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1802ccaf-8ee3-4c78-9309-8f1091e4b389 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:09.293668 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:09.293668 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:09.294673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1802ccaf-8ee3-4c78-9309-8f1091e4b389 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:09.295417 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1802ccaf-8ee3-4c78-9309-8f1091e4b389 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Searching by: {'deleted': False, 'project_id': '5df652172dff4ee08b4dddf7a40b0142'} {{(pid=116514) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 19:09:09.303845 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-92513746-f7cc-4fe1-89d6-b502d6116105 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:09.304758 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-92513746-f7cc-4fe1-89d6-b502d6116105 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:09.305589 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1802ccaf-8ee3-4c78-9309-8f1091e4b389 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:09.306043 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1802ccaf-8ee3-4c78-9309-8f1091e4b389 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:09.306858 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1802ccaf-8ee3-4c78-9309-8f1091e4b389 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:09.307294 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1802ccaf-8ee3-4c78-9309-8f1091e4b389 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:09.310737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-92513746-f7cc-4fe1-89d6-b502d6116105 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:09.311187 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-92513746-f7cc-4fe1-89d6-b502d6116105 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:09.311972 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-92513746-f7cc-4fe1-89d6-b502d6116105 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:09.312411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-92513746-f7cc-4fe1-89d6-b502d6116105 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:09.391103 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-92513746-f7cc-4fe1-89d6-b502d6116105 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 30395 microversion: 2.20 time: 0.091345 Dec 15 19:09:09.394640 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 459/967] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:09 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 30395 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:09:09.398574 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.multi_cell_list [None req-1802ccaf-8ee3-4c78-9309-8f1091e4b389 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 19:09:09.487625 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1802ccaf-8ee3-4c78-9309-8f1091e4b389 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201192 Dec 15 19:09:09.488675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 509/968] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Dec 15 19:09:09 2021] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:09.499290 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6139a2a3-2bea-413e-9b3f-53f8ff9e1822 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:09.499992 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6139a2a3-2bea-413e-9b3f-53f8ff9e1822 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:09.507409 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6139a2a3-2bea-413e-9b3f-53f8ff9e1822 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:09.507854 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6139a2a3-2bea-413e-9b3f-53f8ff9e1822 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:09.508627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6139a2a3-2bea-413e-9b3f-53f8ff9e1822 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:09.509063 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6139a2a3-2bea-413e-9b3f-53f8ff9e1822 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:09.639593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6139a2a3-2bea-413e-9b3f-53f8ff9e1822 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:09.647822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6139a2a3-2bea-413e-9b3f-53f8ff9e1822 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1549 microversion: 2.1 time: 0.152725 Dec 15 19:09:09.648385 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 460/969] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:09 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:10.403663 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4d17bb8b-ab87-404a-a15c-758e4e004ac8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:10.404600 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4d17bb8b-ab87-404a-a15c-758e4e004ac8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:10.411648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d17bb8b-ab87-404a-a15c-758e4e004ac8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:10.412104 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d17bb8b-ab87-404a-a15c-758e4e004ac8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:10.412885 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d17bb8b-ab87-404a-a15c-758e4e004ac8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:10.413344 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d17bb8b-ab87-404a-a15c-758e4e004ac8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:10.487336 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4d17bb8b-ab87-404a-a15c-758e4e004ac8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 32307 microversion: 2.20 time: 0.087214 Dec 15 19:09:10.488142 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 510/970] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:10 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 32307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:11.431774 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1f47dd8a-a5fd-4c79-96ec-321b1af1cc9a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6cd72f0-87f7-49d2-aacd-9c91649c3008"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:11.432829 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1f47dd8a-a5fd-4c79-96ec-321b1af1cc9a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:11.439080 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1f47dd8a-a5fd-4c79-96ec-321b1af1cc9a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:11.439530 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1f47dd8a-a5fd-4c79-96ec-321b1af1cc9a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:11.440302 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1f47dd8a-a5fd-4c79-96ec-321b1af1cc9a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:11.440749 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1f47dd8a-a5fd-4c79-96ec-321b1af1cc9a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:11.499679 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8423f160-d55a-4558-bc76-e86146ee9faa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:11.500741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8423f160-d55a-4558-bc76-e86146ee9faa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:11.507314 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8423f160-d55a-4558-bc76-e86146ee9faa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:11.507761 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8423f160-d55a-4558-bc76-e86146ee9faa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:11.508530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8423f160-d55a-4558-bc76-e86146ee9faa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:11.508954 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8423f160-d55a-4558-bc76-e86146ee9faa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:11.589066 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8423f160-d55a-4558-bc76-e86146ee9faa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 33310 microversion: 2.20 time: 0.093472 Dec 15 19:09:11.589755 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 511/971] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:11 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 33310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:09:12.185334 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8b8ae540-7dbc-49c2-9182-5eef0e473578 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:12.186359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8b8ae540-7dbc-49c2-9182-5eef0e473578 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:12.193145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8b8ae540-7dbc-49c2-9182-5eef0e473578 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:12.193597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8b8ae540-7dbc-49c2-9182-5eef0e473578 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:12.194362 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8b8ae540-7dbc-49c2-9182-5eef0e473578 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:12.194794 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8b8ae540-7dbc-49c2-9182-5eef0e473578 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:12.203285 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1f47dd8a-a5fd-4c79-96ec-321b1af1cc9a tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "POST /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775129 Dec 15 19:09:12.203965 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 461/972] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:09:11 2021] POST /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:12.226785 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8b8ae540-7dbc-49c2-9182-5eef0e473578 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045623 Dec 15 19:09:12.227357 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 512/973] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:09:12 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 19:09:12.285168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bf4055ca-fb33-410a-9b2e-26d4cfa179e1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:12.285745 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bf4055ca-fb33-410a-9b2e-26d4cfa179e1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:12.292525 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bf4055ca-fb33-410a-9b2e-26d4cfa179e1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:12.294013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bf4055ca-fb33-410a-9b2e-26d4cfa179e1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:12.294013 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bf4055ca-fb33-410a-9b2e-26d4cfa179e1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:12.294236 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bf4055ca-fb33-410a-9b2e-26d4cfa179e1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:12.318916 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bf4055ca-fb33-410a-9b2e-26d4cfa179e1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:09:12.600335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1bc4c557-c3a4-4cd4-92e8-927efebd865a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:12.601188 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1bc4c557-c3a4-4cd4-92e8-927efebd865a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:12.607404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1bc4c557-c3a4-4cd4-92e8-927efebd865a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:12.607855 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1bc4c557-c3a4-4cd4-92e8-927efebd865a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:12.608683 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1bc4c557-c3a4-4cd4-92e8-927efebd865a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:12.609139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1bc4c557-c3a4-4cd4-92e8-927efebd865a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:12.611041 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bf4055ca-fb33-410a-9b2e-26d4cfa179e1 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 204 len: 0 microversion: 2.1 time: 0.329566 Dec 15 19:09:12.611745 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 462/974] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:09:12 2021] DELETE /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:09:12.620034 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4a2d30ee-9abe-483c-b5ef-a78b724981dc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:12.621026 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4a2d30ee-9abe-483c-b5ef-a78b724981dc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:12.626718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4a2d30ee-9abe-483c-b5ef-a78b724981dc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:12.628032 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4a2d30ee-9abe-483c-b5ef-a78b724981dc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:12.628032 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4a2d30ee-9abe-483c-b5ef-a78b724981dc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:12.628464 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4a2d30ee-9abe-483c-b5ef-a78b724981dc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:12.685998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1bc4c557-c3a4-4cd4-92e8-927efebd865a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 34107 microversion: 2.20 time: 0.089131 Dec 15 19:09:12.686961 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 513/975] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:12 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 34107 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 19:09:12.773184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4a2d30ee-9abe-483c-b5ef-a78b724981dc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:12.780582 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4a2d30ee-9abe-483c-b5ef-a78b724981dc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1672 microversion: 2.1 time: 0.164470 Dec 15 19:09:12.781177 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 463/976] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:12 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:13.700106 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0fc1c01f-6bf4-4ddf-8726-bda374bbbcb2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:13.700997 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0fc1c01f-6bf4-4ddf-8726-bda374bbbcb2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:13.707999 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0fc1c01f-6bf4-4ddf-8726-bda374bbbcb2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:13.708435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0fc1c01f-6bf4-4ddf-8726-bda374bbbcb2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:13.709773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0fc1c01f-6bf4-4ddf-8726-bda374bbbcb2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:13.710202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0fc1c01f-6bf4-4ddf-8726-bda374bbbcb2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:13.794130 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0fc1c01f-6bf4-4ddf-8726-bda374bbbcb2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 34984 microversion: 2.20 time: 0.098009 Dec 15 19:09:13.794977 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 514/977] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:13 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 34984 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:13.797042 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-64308701-9e8d-451f-ac51-af6c8c5ba61b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:13.797676 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-64308701-9e8d-451f-ac51-af6c8c5ba61b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:13.804033 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-64308701-9e8d-451f-ac51-af6c8c5ba61b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:13.804474 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-64308701-9e8d-451f-ac51-af6c8c5ba61b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:13.805307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-64308701-9e8d-451f-ac51-af6c8c5ba61b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:13.805834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-64308701-9e8d-451f-ac51-af6c8c5ba61b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:13.933924 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-64308701-9e8d-451f-ac51-af6c8c5ba61b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:13.941051 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-64308701-9e8d-451f-ac51-af6c8c5ba61b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1672 microversion: 2.1 time: 0.147719 Dec 15 19:09:13.941628 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 464/978] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:13 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:14.807091 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2e5fae76-ea97-478a-8942-78c192512c15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:14.808081 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2e5fae76-ea97-478a-8942-78c192512c15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:14.814894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2e5fae76-ea97-478a-8942-78c192512c15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:14.815345 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2e5fae76-ea97-478a-8942-78c192512c15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:14.816129 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2e5fae76-ea97-478a-8942-78c192512c15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:14.816565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2e5fae76-ea97-478a-8942-78c192512c15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:14.905580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2e5fae76-ea97-478a-8942-78c192512c15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 35780 microversion: 2.20 time: 0.102953 Dec 15 19:09:14.906313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 515/979] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:14 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 35780 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:14.964562 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8b79db70-9a5c-40a4-8429-374741de2c95 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:14.965188 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8b79db70-9a5c-40a4-8429-374741de2c95 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:14.971324 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8b79db70-9a5c-40a4-8429-374741de2c95 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:14.971769 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8b79db70-9a5c-40a4-8429-374741de2c95 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:14.972540 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8b79db70-9a5c-40a4-8429-374741de2c95 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:14.972972 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8b79db70-9a5c-40a4-8429-374741de2c95 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:15.176988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8b79db70-9a5c-40a4-8429-374741de2c95 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:15.184834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8b79db70-9a5c-40a4-8429-374741de2c95 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1672 microversion: 2.1 time: 0.223932 Dec 15 19:09:15.185523 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 465/980] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:14 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:15.860343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-97f279aa-8c98-42dc-be05-8c8f8a429326 req-6ee71606-b791-492c-a4eb-b51770587623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d9554d-bb60-4d4e-9ab8-311caafb659f", "name": "network-vif-deleted", "tag": "29640191-71ad-4c57-b1eb-eb8f4de83e2b"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:15.860343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:15.860343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:15.860343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-97f279aa-8c98-42dc-be05-8c8f8a429326 req-6ee71606-b791-492c-a4eb-b51770587623 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:15.860343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-97f279aa-8c98-42dc-be05-8c8f8a429326 req-6ee71606-b791-492c-a4eb-b51770587623 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:15.867087 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-97f279aa-8c98-42dc-be05-8c8f8a429326 req-6ee71606-b791-492c-a4eb-b51770587623 service nova] Creating event network-vif-deleted:29640191-71ad-4c57-b1eb-eb8f4de83e2b for instance 92d9554d-bb60-4d4e-9ab8-311caafb659f on hv-cinder-81268 Dec 15 19:09:15.872250 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-97f279aa-8c98-42dc-be05-8c8f8a429326 req-6ee71606-b791-492c-a4eb-b51770587623 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030246 Dec 15 19:09:15.872848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 516/981] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:15.918538 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2feb288f-77fa-45f7-8302-19f3dc265bfb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:15.923636 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2feb288f-77fa-45f7-8302-19f3dc265bfb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:15.927021 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2feb288f-77fa-45f7-8302-19f3dc265bfb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:15.927488 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2feb288f-77fa-45f7-8302-19f3dc265bfb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:15.928334 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2feb288f-77fa-45f7-8302-19f3dc265bfb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:15.928780 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2feb288f-77fa-45f7-8302-19f3dc265bfb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:16.010121 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2feb288f-77fa-45f7-8302-19f3dc265bfb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 37022 microversion: 2.20 time: 0.095754 Dec 15 19:09:16.014670 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 466/982] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:15 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 37022 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:16.203553 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:16.204161 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:16.210674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:16.213149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:16.213149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:16.213149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:16.242763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:16.243211 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:16.243656 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lazy-loading 'fault' on Instance uuid 92d9554d-bb60-4d4e-9ab8-311caafb659f {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:09:16.520886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:16.528948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-22c1682d-d7e7-4f63-b34c-f866c0b1d69c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 200 len: 1327 microversion: 2.1 time: 0.329913 Dec 15 19:09:16.530069 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 517/983] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:16 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 1327 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:17.022528 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1b8c565a-68e7-42be-8771-cf1b54257855 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:17.023565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1b8c565a-68e7-42be-8771-cf1b54257855 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:17.031097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1b8c565a-68e7-42be-8771-cf1b54257855 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:17.031542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1b8c565a-68e7-42be-8771-cf1b54257855 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:17.032308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1b8c565a-68e7-42be-8771-cf1b54257855 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:17.032735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1b8c565a-68e7-42be-8771-cf1b54257855 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:17.106148 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1b8c565a-68e7-42be-8771-cf1b54257855 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 38229 microversion: 2.20 time: 0.087511 Dec 15 19:09:17.106797 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 467/984] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:17 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 38229 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:17.545913 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d7eb5358-4257-43df-a6b6-d562d81547f9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:17.546516 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d7eb5358-4257-43df-a6b6-d562d81547f9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:17.552707 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7eb5358-4257-43df-a6b6-d562d81547f9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:17.553192 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7eb5358-4257-43df-a6b6-d562d81547f9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:17.553961 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7eb5358-4257-43df-a6b6-d562d81547f9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:17.554389 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7eb5358-4257-43df-a6b6-d562d81547f9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:17.567123 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-d7eb5358-4257-43df-a6b6-d562d81547f9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] HTTP exception thrown: Instance 92d9554d-bb60-4d4e-9ab8-311caafb659f could not be found. Dec 15 19:09:17.568377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d7eb5358-4257-43df-a6b6-d562d81547f9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Returning 404 to user: Instance 92d9554d-bb60-4d4e-9ab8-311caafb659f could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:09:17.568513 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d7eb5358-4257-43df-a6b6-d562d81547f9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 404 len: 111 microversion: 2.1 time: 0.026227 Dec 15 19:09:17.569019 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 518/985] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:17 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 19:09:17.577576 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9d67b760-c7ab-49c6-9972-6e41d5a76d38 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '.version_select at 0x7f80ba7f3040>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:17.674563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9d67b760-c7ab-49c6-9972-6e41d5a76d38 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-776574122" status: 202 len: 0 microversion: 2.1 time: 0.100793 Dec 15 19:09:17.675116 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 468/986] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Dec 15 19:09:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-776574122 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:18.118531 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5b92c162-69a9-4c41-b42e-90bfba3553ab tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:18.119469 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5b92c162-69a9-4c41-b42e-90bfba3553ab tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:18.125903 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b92c162-69a9-4c41-b42e-90bfba3553ab tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:18.126374 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b92c162-69a9-4c41-b42e-90bfba3553ab tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:18.127124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b92c162-69a9-4c41-b42e-90bfba3553ab tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:18.127558 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b92c162-69a9-4c41-b42e-90bfba3553ab tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:18.202288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5b92c162-69a9-4c41-b42e-90bfba3553ab tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 38229 microversion: 2.20 time: 0.087755 Dec 15 19:09:18.206509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 519/987] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:18 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 38229 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:18.410751 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c2af194c-e99b-48eb-a617-bc0bd6234a06 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'create', calling method: .version_select at 0x7f80ba86b280>, body: {"keypair": {"name": "tempest-keypair-1434598661"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:18.424958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-c2af194c-e99b-48eb-a617-bc0bd6234a06 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:09:18.429268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-c2af194c-e99b-48eb-a617-bc0bd6234a06 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for user c23109dba24548acb418028b9578f1f8 and project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:09:18.899035 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-c2af194c-e99b-48eb-a617-bc0bd6234a06 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:09:18.903031 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-c2af194c-e99b-48eb-a617-bc0bd6234a06 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for user c23109dba24548acb418028b9578f1f8 and project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:09:18.916493 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c2af194c-e99b-48eb-a617-bc0bd6234a06 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.509470 Dec 15 19:09:18.917373 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 469/988] 10.222.0.49 () {60 vars in 1157 bytes} [Wed Dec 15 19:09:18 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:19.214858 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c4e0fd4e-e53b-4102-9efa-96e33eb2bd44 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:19.215849 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c4e0fd4e-e53b-4102-9efa-96e33eb2bd44 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:19.222699 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4e0fd4e-e53b-4102-9efa-96e33eb2bd44 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:19.223145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4e0fd4e-e53b-4102-9efa-96e33eb2bd44 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:19.223920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4e0fd4e-e53b-4102-9efa-96e33eb2bd44 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:19.224374 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c4e0fd4e-e53b-4102-9efa-96e33eb2bd44 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:19.287857 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c4e0fd4e-e53b-4102-9efa-96e33eb2bd44 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 38229 microversion: 2.20 time: 0.076999 Dec 15 19:09:19.288497 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 520/989] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:19 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 38229 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:19.722198 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e100d36a-a4d4-4650-bea3-88adcafb072e tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:19.722911 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e100d36a-a4d4-4650-bea3-88adcafb072e tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:19.728901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e100d36a-a4d4-4650-bea3-88adcafb072e tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:19.729469 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e100d36a-a4d4-4650-bea3-88adcafb072e tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:19.730264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e100d36a-a4d4-4650-bea3-88adcafb072e tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:19.730698 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e100d36a-a4d4-4650-bea3-88adcafb072e tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:19.894193 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e100d36a-a4d4-4650-bea3-88adcafb072e tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:19.901875 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e100d36a-a4d4-4650-bea3-88adcafb072e tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1595 microversion: 2.1 time: 0.183800 Dec 15 19:09:19.902447 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 470/990] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:19 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1595 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:20.299734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6f9ff8c9-068e-4d31-a369-698b43ea4787 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:20.300648 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6f9ff8c9-068e-4d31-a369-698b43ea4787 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:20.308216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6f9ff8c9-068e-4d31-a369-698b43ea4787 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:20.308670 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6f9ff8c9-068e-4d31-a369-698b43ea4787 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:20.309489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6f9ff8c9-068e-4d31-a369-698b43ea4787 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:20.309944 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6f9ff8c9-068e-4d31-a369-698b43ea4787 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:20.382890 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6f9ff8c9-068e-4d31-a369-698b43ea4787 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 200 len: 38372 microversion: 2.20 time: 0.087332 Dec 15 19:09:20.389146 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 521/991] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:20 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 38372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:20.394125 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6a231dd8-6dea-4f67-95ef-116402a1419e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:20.394629 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6a231dd8-6dea-4f67-95ef-116402a1419e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:20.400848 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a231dd8-6dea-4f67-95ef-116402a1419e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:20.401401 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a231dd8-6dea-4f67-95ef-116402a1419e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:20.402184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a231dd8-6dea-4f67-95ef-116402a1419e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:20.402626 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6a231dd8-6dea-4f67-95ef-116402a1419e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:20.426168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6a231dd8-6dea-4f67-95ef-116402a1419e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/ips" status: 200 len: 150 microversion: 2.20 time: 0.035655 Dec 15 19:09:20.426752 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 471/992] 10.222.0.49 () {60 vars in 1288 bytes} [Wed Dec 15 19:09:20 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:09:21.983793 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-833214318", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a16e66f-ed7c-442f-a539-7233fbc514d4"}], "security_groups": [{"name": "tempest-securitygroup--1310269424"}], "key_name": "tempest-keypair-1434598661", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:22.089852 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] validate_networks() for [('7a16e66f-ed7c-442f-a539-7233fbc514d4', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:09:22.503068 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:09:22.503492 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:09:22.503961 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:09:22.504370 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:09:22.504775 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:09:22.513177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:22.513627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:22.514446 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:22.514933 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:22.546099 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:09:22.550059 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Getting quotas for user c23109dba24548acb418028b9578f1f8 and project 10e0bf29ca2c44d5ba3c4306a437e9cc. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:09:22.561542 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:09:22.563998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:09:22.679146 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7d69f169-ad9d-48e8-8911-882d2f08904f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:22.679679 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7d69f169-ad9d-48e8-8911-882d2f08904f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:22.685916 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7d69f169-ad9d-48e8-8911-882d2f08904f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:22.686353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7d69f169-ad9d-48e8-8911-882d2f08904f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:22.687124 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7d69f169-ad9d-48e8-8911-882d2f08904f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:22.687542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7d69f169-ad9d-48e8-8911-882d2f08904f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:22.711378 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-7d69f169-ad9d-48e8-8911-882d2f08904f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lazy-loading 'flavor' on Instance uuid 2a8ea341-62ac-42cb-8ae6-b14554543d64 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:09:22.734531 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5b7fee17-e538-451b-83da-94d28890e16c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.755077 Dec 15 19:09:22.735218 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 522/993] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:09:21 2021] POST /compute/v2.1/servers => generated 402 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:09:22.745459 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-db6f53fb-730a-4151-96c5-6b0e39ea1a90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:22.746098 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-db6f53fb-730a-4151-96c5-6b0e39ea1a90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:22.830836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-db6f53fb-730a-4151-96c5-6b0e39ea1a90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:22.839650 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-db6f53fb-730a-4151-96c5-6b0e39ea1a90 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1237 microversion: 2.1 time: 0.098029 Dec 15 19:09:22.843435 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 523/994] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:22 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:22.978550 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-62e87816-67a6-4eef-9ab8-2fb4120af54f req-b7b71991-e93b-45c3-950b-5d0a39c71739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0c4ba6-607a-4213-adfc-22306c7c61bd", "tag": "b5f44d8c-08ee-4a4e-85f0-5c1829876e7e"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:22.980102 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:22.980102 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:22.987812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-62e87816-67a6-4eef-9ab8-2fb4120af54f req-b7b71991-e93b-45c3-950b-5d0a39c71739 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:22.988432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-62e87816-67a6-4eef-9ab8-2fb4120af54f req-b7b71991-e93b-45c3-950b-5d0a39c71739 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:22.999101 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-62e87816-67a6-4eef-9ab8-2fb4120af54f req-b7b71991-e93b-45c3-950b-5d0a39c71739 service nova] Creating event network-changed:b5f44d8c-08ee-4a4e-85f0-5c1829876e7e for instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd on hv-cinder-81268 Dec 15 19:09:23.004261 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-62e87816-67a6-4eef-9ab8-2fb4120af54f req-b7b71991-e93b-45c3-950b-5d0a39c71739 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029632 Dec 15 19:09:23.005039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 524/995] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:09:23.351361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7d69f169-ad9d-48e8-8911-882d2f08904f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 202 len: 0 microversion: 2.20 time: 0.675750 Dec 15 19:09:23.355509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 472/996] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:22 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:09:23.362565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:23.363077 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:23.372619 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:23.381053 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:23.381053 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:23.381053 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:23.558511 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:23.568898 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:23.571605 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:23.572918 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-78d5c90f-97b8-4140-b5c3-f361f90eddf2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.215680 Dec 15 19:09:23.573629 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 525/997] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:23 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:23.863838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-240176a2-5455-4b9a-a47c-16928039e2c3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:23.864659 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-240176a2-5455-4b9a-a47c-16928039e2c3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:23.872178 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-240176a2-5455-4b9a-a47c-16928039e2c3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:23.877773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-240176a2-5455-4b9a-a47c-16928039e2c3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:23.877773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-240176a2-5455-4b9a-a47c-16928039e2c3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:23.877773 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-240176a2-5455-4b9a-a47c-16928039e2c3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:23.946128 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-240176a2-5455-4b9a-a47c-16928039e2c3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:23.953573 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-240176a2-5455-4b9a-a47c-16928039e2c3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1241 microversion: 2.1 time: 0.094347 Dec 15 19:09:23.954298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 473/998] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:23 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:24.591542 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:24.592147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:24.598296 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:24.598743 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:24.599592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:24.600036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:24.752566 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:24.761139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:24.763330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:24.764552 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e87d7f45-a426-4fcc-9db8-e4ffeb412824 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.176813 Dec 15 19:09:24.765145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 526/999] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:24 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:24.970536 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b3befac0-fd9a-4472-b95e-f04386bdc137 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:24.971139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b3befac0-fd9a-4472-b95e-f04386bdc137 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:24.977531 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b3befac0-fd9a-4472-b95e-f04386bdc137 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:24.977978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b3befac0-fd9a-4472-b95e-f04386bdc137 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:24.978751 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b3befac0-fd9a-4472-b95e-f04386bdc137 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:24.979183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b3befac0-fd9a-4472-b95e-f04386bdc137 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:25.054300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b3befac0-fd9a-4472-b95e-f04386bdc137 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:25.061718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b3befac0-fd9a-4472-b95e-f04386bdc137 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1297 microversion: 2.1 time: 0.094898 Dec 15 19:09:25.062593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 474/1000] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:24 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:25.421860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b495eb5f-8bc4-4fe4-b3ed-e19103cb5958 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1745562836"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:25.422432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b495eb5f-8bc4-4fe4-b3ed-e19103cb5958 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:25.428817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b495eb5f-8bc4-4fe4-b3ed-e19103cb5958 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:25.429305 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b495eb5f-8bc4-4fe4-b3ed-e19103cb5958 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:25.430091 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b495eb5f-8bc4-4fe4-b3ed-e19103cb5958 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:25.430621 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b495eb5f-8bc4-4fe4-b3ed-e19103cb5958 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:25.559860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.network.security_group_api [None req-b495eb5f-8bc4-4fe4-b3ed-e19103cb5958 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Adding security group 3f4d5545-fc2d-40a8-a4db-c0e483a62f37 to port b5f44d8c-08ee-4a4e-85f0-5c1829876e7e Dec 15 19:09:25.783015 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:25.783761 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:25.794046 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:25.794495 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:25.795302 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:25.795736 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:26.009882 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b495eb5f-8bc4-4fe4-b3ed-e19103cb5958 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "POST /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/action" status: 202 len: 0 microversion: 2.1 time: 0.591386 Dec 15 19:09:26.012860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 527/1001] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:25 2021] POST /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:26.027959 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:26.049983 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:26.065530 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:26.068527 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5fcd3898-7881-46d2-afcc-8c0343a00278 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.288647 Dec 15 19:09:26.069673 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 475/1002] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:25 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:09:26.076115 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b2c8d07d-bae8-4f0f-8026-54806498d509 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:26.077170 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b2c8d07d-bae8-4f0f-8026-54806498d509 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:26.085275 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b2c8d07d-bae8-4f0f-8026-54806498d509 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:26.085946 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b2c8d07d-bae8-4f0f-8026-54806498d509 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:26.087185 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b2c8d07d-bae8-4f0f-8026-54806498d509 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:26.087803 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b2c8d07d-bae8-4f0f-8026-54806498d509 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:26.121816 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-5833d2f7-fa38-41a5-9744-87656b162e8d req-3210c308-5b0e-4b72-b14f-c12dbe1a92d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0c4ba6-607a-4213-adfc-22306c7c61bd", "tag": "b5f44d8c-08ee-4a4e-85f0-5c1829876e7e"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:26.126652 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:26.126652 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:26.136884 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-5833d2f7-fa38-41a5-9744-87656b162e8d req-3210c308-5b0e-4b72-b14f-c12dbe1a92d5 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:26.137556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-5833d2f7-fa38-41a5-9744-87656b162e8d req-3210c308-5b0e-4b72-b14f-c12dbe1a92d5 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:26.157039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-5833d2f7-fa38-41a5-9744-87656b162e8d req-3210c308-5b0e-4b72-b14f-c12dbe1a92d5 service nova] Creating event network-changed:b5f44d8c-08ee-4a4e-85f0-5c1829876e7e for instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd on hv-cinder-81268 Dec 15 19:09:26.164973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-5833d2f7-fa38-41a5-9744-87656b162e8d req-3210c308-5b0e-4b72-b14f-c12dbe1a92d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149060 Dec 15 19:09:26.166973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 528/1003] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:26.174471 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c8e2055f-2164-4d43-8ca9-3acf920d0c9b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:26.175717 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c8e2055f-2164-4d43-8ca9-3acf920d0c9b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:26.182753 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c8e2055f-2164-4d43-8ca9-3acf920d0c9b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:26.183449 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c8e2055f-2164-4d43-8ca9-3acf920d0c9b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:26.184452 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c8e2055f-2164-4d43-8ca9-3acf920d0c9b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:26.185363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c8e2055f-2164-4d43-8ca9-3acf920d0c9b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:26.427963 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c8e2055f-2164-4d43-8ca9-3acf920d0c9b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:26.435619 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c8e2055f-2164-4d43-8ca9-3acf920d0c9b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1363 microversion: 2.1 time: 0.267221 Dec 15 19:09:26.436438 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 529/1004] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:26 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:26.454358 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b2c8d07d-bae8-4f0f-8026-54806498d509 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:26.462752 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b2c8d07d-bae8-4f0f-8026-54806498d509 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1761 microversion: 2.1 time: 0.391875 Dec 15 19:09:26.463427 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 476/1005] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:26 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1761 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:26.872163 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-ed0f9ac8-c6db-4787-bdbb-96d7ef8fd495 req-e3567f3f-f88a-4b4c-b2cf-c02c75de567b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633f7767-df32-4ca3-986c-07c1c0a517b7", "tag": "76e0bcfc-5319-45ee-ba0d-5566b3fc3537"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:26.880946 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:26.880946 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:26.884814 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-ed0f9ac8-c6db-4787-bdbb-96d7ef8fd495 req-e3567f3f-f88a-4b4c-b2cf-c02c75de567b service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:26.884814 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-ed0f9ac8-c6db-4787-bdbb-96d7ef8fd495 req-e3567f3f-f88a-4b4c-b2cf-c02c75de567b service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:26.898126 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-ed0f9ac8-c6db-4787-bdbb-96d7ef8fd495 req-e3567f3f-f88a-4b4c-b2cf-c02c75de567b service nova] Creating event network-changed:76e0bcfc-5319-45ee-ba0d-5566b3fc3537 for instance 633f7767-df32-4ca3-986c-07c1c0a517b7 on hv-cinder-81268 Dec 15 19:09:26.902944 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-ed0f9ac8-c6db-4787-bdbb-96d7ef8fd495 req-e3567f3f-f88a-4b4c-b2cf-c02c75de567b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036105 Dec 15 19:09:26.903663 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 530/1006] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:27.088790 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:27.089546 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:27.096122 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:27.096573 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:27.097426 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:27.097871 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:27.270591 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:27.278457 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:27.279968 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:27.281158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-51104f2b-d8dc-4e8a-aefb-53b060b395f2 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.196147 Dec 15 19:09:27.281758 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 477/1007] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:27 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:27.457354 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a484873b-0535-43b0-a082-577a32f75599 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:27.461838 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a484873b-0535-43b0-a082-577a32f75599 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:27.464107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a484873b-0535-43b0-a082-577a32f75599 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:27.464548 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a484873b-0535-43b0-a082-577a32f75599 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:27.465511 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a484873b-0535-43b0-a082-577a32f75599 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:27.465949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a484873b-0535-43b0-a082-577a32f75599 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:27.598303 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a484873b-0535-43b0-a082-577a32f75599 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:27.606151 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a484873b-0535-43b0-a082-577a32f75599 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1363 microversion: 2.1 time: 0.152993 Dec 15 19:09:27.606725 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 531/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:27 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:28.299197 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:28.299809 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:28.306917 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:28.307367 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:28.308146 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:28.308583 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:28.439998 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:28.447783 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:28.449329 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:28.450478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5cfc9d1b-1509-441c-bcff-d155f36c0e70 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.154991 Dec 15 19:09:28.451041 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 478/1009] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:28 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:28.623644 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-22186311-13f5-44c1-9ea3-49f91caf2fdf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:28.624180 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-22186311-13f5-44c1-9ea3-49f91caf2fdf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:28.630550 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22186311-13f5-44c1-9ea3-49f91caf2fdf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:28.631005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22186311-13f5-44c1-9ea3-49f91caf2fdf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:28.631785 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22186311-13f5-44c1-9ea3-49f91caf2fdf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:28.632225 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22186311-13f5-44c1-9ea3-49f91caf2fdf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:28.689462 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4cb74736-6ef5-4ba4-be40-058b5ca03f90 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:28.689961 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4cb74736-6ef5-4ba4-be40-058b5ca03f90 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:28.695878 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4cb74736-6ef5-4ba4-be40-058b5ca03f90 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:28.696336 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4cb74736-6ef5-4ba4-be40-058b5ca03f90 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:28.697149 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4cb74736-6ef5-4ba4-be40-058b5ca03f90 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:28.697596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4cb74736-6ef5-4ba4-be40-058b5ca03f90 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:28.722353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4cb74736-6ef5-4ba4-be40-058b5ca03f90 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:09:28.766654 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-22186311-13f5-44c1-9ea3-49f91caf2fdf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:28.774517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-22186311-13f5-44c1-9ea3-49f91caf2fdf tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1363 microversion: 2.1 time: 0.154851 Dec 15 19:09:28.775094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 532/1010] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:28 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:29.024702 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4cb74736-6ef5-4ba4-be40-058b5ca03f90 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "DELETE /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 204 len: 0 microversion: 2.1 time: 0.338629 Dec 15 19:09:29.025319 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 479/1011] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:09:28 2021] DELETE /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 19:09:29.033195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fbf787e3-a686-4694-bdcb-b35e28ef932a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:29.033813 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fbf787e3-a686-4694-bdcb-b35e28ef932a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:29.039717 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fbf787e3-a686-4694-bdcb-b35e28ef932a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:29.040170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fbf787e3-a686-4694-bdcb-b35e28ef932a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:29.040950 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fbf787e3-a686-4694-bdcb-b35e28ef932a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:29.041450 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fbf787e3-a686-4694-bdcb-b35e28ef932a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:29.168704 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fbf787e3-a686-4694-bdcb-b35e28ef932a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:29.176102 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fbf787e3-a686-4694-bdcb-b35e28ef932a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1575 microversion: 2.1 time: 0.146545 Dec 15 19:09:29.176677 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 533/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:29 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:29.468822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:29.469558 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:29.475946 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:29.476394 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:29.477215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:29.477641 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:29.607662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:29.615873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:29.617406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:29.618554 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-18db158a-a936-4d5e-9da1-55ff33ec8721 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.153811 Dec 15 19:09:29.619115 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 480/1013] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:29 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:29.791649 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0df900c0-1868-49d9-a62d-18a5af946a01 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:29.792255 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0df900c0-1868-49d9-a62d-18a5af946a01 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:29.798565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0df900c0-1868-49d9-a62d-18a5af946a01 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:29.799018 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0df900c0-1868-49d9-a62d-18a5af946a01 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:29.799792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0df900c0-1868-49d9-a62d-18a5af946a01 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:29.800224 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0df900c0-1868-49d9-a62d-18a5af946a01 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:29.927751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0df900c0-1868-49d9-a62d-18a5af946a01 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:29.935095 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0df900c0-1868-49d9-a62d-18a5af946a01 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1363 microversion: 2.1 time: 0.147122 Dec 15 19:09:29.935662 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 534/1014] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:29 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:30.193583 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a0a5f160-1bc2-4b64-8ea0-2a380c3ca5b5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:30.194112 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a0a5f160-1bc2-4b64-8ea0-2a380c3ca5b5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:30.199993 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0a5f160-1bc2-4b64-8ea0-2a380c3ca5b5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:30.200442 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0a5f160-1bc2-4b64-8ea0-2a380c3ca5b5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:30.201243 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0a5f160-1bc2-4b64-8ea0-2a380c3ca5b5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:30.201684 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a0a5f160-1bc2-4b64-8ea0-2a380c3ca5b5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:30.333692 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a0a5f160-1bc2-4b64-8ea0-2a380c3ca5b5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:30.340972 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a0a5f160-1bc2-4b64-8ea0-2a380c3ca5b5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1575 microversion: 2.1 time: 0.151169 Dec 15 19:09:30.341578 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 481/1015] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:30 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:30.637020 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:30.637659 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:30.643580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:30.644029 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:30.644843 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:30.645305 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:30.777890 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:30.785969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:30.787580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:30.788637 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-27ca4106-bdef-43aa-9e7f-8237e00ea683 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.155470 Dec 15 19:09:30.789476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 535/1016] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:30 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:30.951675 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c1ffa866-5ba4-4229-8ba4-cf86f40fb889 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:30.952301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c1ffa866-5ba4-4229-8ba4-cf86f40fb889 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:30.959241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c1ffa866-5ba4-4229-8ba4-cf86f40fb889 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:30.959709 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c1ffa866-5ba4-4229-8ba4-cf86f40fb889 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:30.960565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c1ffa866-5ba4-4229-8ba4-cf86f40fb889 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:30.961074 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c1ffa866-5ba4-4229-8ba4-cf86f40fb889 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:31.188841 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c1ffa866-5ba4-4229-8ba4-cf86f40fb889 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:31.196850 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c1ffa866-5ba4-4229-8ba4-cf86f40fb889 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1363 microversion: 2.1 time: 0.248956 Dec 15 19:09:31.197462 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 482/1017] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:30 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:31.359466 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1b3d0a5e-5658-42cb-b640-27b3f49da4a5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:31.360212 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1b3d0a5e-5658-42cb-b640-27b3f49da4a5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:31.366777 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1b3d0a5e-5658-42cb-b640-27b3f49da4a5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:31.367477 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1b3d0a5e-5658-42cb-b640-27b3f49da4a5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:31.368329 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1b3d0a5e-5658-42cb-b640-27b3f49da4a5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:31.368768 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1b3d0a5e-5658-42cb-b640-27b3f49da4a5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:31.429481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1b3d0a5e-5658-42cb-b640-27b3f49da4a5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:31.436744 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1b3d0a5e-5658-42cb-b640-27b3f49da4a5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1509 microversion: 2.1 time: 0.081945 Dec 15 19:09:31.437343 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 536/1018] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:31 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1509 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:31.807288 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:31.807798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:31.814018 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:31.814507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:31.815311 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:31.815751 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:31.909058 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-d865cae6-142a-4ce8-b04f-0995036b0b56 req-3e855106-29d0-4ad6-b677-0ebeefb85e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688fbf24-7c98-4e51-8d6d-3a9f84044719", "name": "network-vif-deleted", "tag": "3d828ab8-0ca7-48b9-813f-689cb063f4ad"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:31.920256 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:31.920256 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:31.935288 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-d865cae6-142a-4ce8-b04f-0995036b0b56 req-3e855106-29d0-4ad6-b677-0ebeefb85e9a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:31.935693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-d865cae6-142a-4ce8-b04f-0995036b0b56 req-3e855106-29d0-4ad6-b677-0ebeefb85e9a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:31.947011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-d865cae6-142a-4ce8-b04f-0995036b0b56 req-3e855106-29d0-4ad6-b677-0ebeefb85e9a service nova] Creating event network-vif-deleted:3d828ab8-0ca7-48b9-813f-689cb063f4ad for instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 on hv-cinder-81268 Dec 15 19:09:31.951984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-d865cae6-142a-4ce8-b04f-0995036b0b56 req-3e855106-29d0-4ad6-b677-0ebeefb85e9a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046796 Dec 15 19:09:31.952996 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 537/1019] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:31.987861 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:31.996834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:31.998371 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:31.999528 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6d996d64-8cb9-44f1-aed7-c9dc2ce7bd96 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.196128 Dec 15 19:09:32.000094 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 483/1020] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:31 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:32.213900 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1c2c294f-080c-4863-85a1-9cd21a4609e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:32.214763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1c2c294f-080c-4863-85a1-9cd21a4609e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:32.220584 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1c2c294f-080c-4863-85a1-9cd21a4609e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:32.225350 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1c2c294f-080c-4863-85a1-9cd21a4609e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:32.225350 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1c2c294f-080c-4863-85a1-9cd21a4609e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:32.225350 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1c2c294f-080c-4863-85a1-9cd21a4609e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:32.365177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1c2c294f-080c-4863-85a1-9cd21a4609e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:32.373669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1c2c294f-080c-4863-85a1-9cd21a4609e3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1363 microversion: 2.1 time: 0.163722 Dec 15 19:09:32.374262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 538/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:32 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:32.454739 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:32.455555 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:32.462215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:32.462665 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:32.463450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:32.463887 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:32.496651 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:32.497388 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:32.497832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lazy-loading 'fault' on Instance uuid 688fbf24-7c98-4e51-8d6d-3a9f84044719 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:09:32.542264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:32.550925 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-40cc6da7-0b47-4b1d-aef2-a3cd16458107 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 200 len: 1229 microversion: 2.1 time: 0.099842 Dec 15 19:09:32.560178 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 484/1022] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:32 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:33.017806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:33.018484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:33.026929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:33.026929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:33.026929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:33.026929 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:33.167379 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:33.175300 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:33.177372 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:33.178541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f7e0a5d3-536e-4a6c-a94d-51a5d001abdf tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.164577 Dec 15 19:09:33.179123 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 539/1023] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:33 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:33.391497 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-dd9252c5-e97e-45e9-b009-bfbbc741c3ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:33.392100 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-dd9252c5-e97e-45e9-b009-bfbbc741c3ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:33.398707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dd9252c5-e97e-45e9-b009-bfbbc741c3ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:33.399234 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dd9252c5-e97e-45e9-b009-bfbbc741c3ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:33.400136 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dd9252c5-e97e-45e9-b009-bfbbc741c3ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:33.400620 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-dd9252c5-e97e-45e9-b009-bfbbc741c3ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:33.537038 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-fdadeeeb-c255-4e5e-bf15-0fa457ec31fc req-c8db5489-30ef-4718-ad6d-1126aaed9512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633f7767-df32-4ca3-986c-07c1c0a517b7", "name": "network-vif-plugged", "status": "completed", "tag": "76e0bcfc-5319-45ee-ba0d-5566b3fc3537"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:33.541848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:33.541848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:33.545670 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-fdadeeeb-c255-4e5e-bf15-0fa457ec31fc req-c8db5489-30ef-4718-ad6d-1126aaed9512 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:33.546120 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-fdadeeeb-c255-4e5e-bf15-0fa457ec31fc req-c8db5489-30ef-4718-ad6d-1126aaed9512 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:33.547350 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-dd9252c5-e97e-45e9-b009-bfbbc741c3ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:33.555310 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-dd9252c5-e97e-45e9-b009-bfbbc741c3ca tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1363 microversion: 2.1 time: 0.167495 Dec 15 19:09:33.555882 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 485/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:33 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:33.557579 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-fdadeeeb-c255-4e5e-bf15-0fa457ec31fc req-c8db5489-30ef-4718-ad6d-1126aaed9512 service nova] Creating event network-vif-plugged:76e0bcfc-5319-45ee-ba0d-5566b3fc3537 for instance 633f7767-df32-4ca3-986c-07c1c0a517b7 on hv-cinder-81268 Dec 15 19:09:33.562823 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-fdadeeeb-c255-4e5e-bf15-0fa457ec31fc req-c8db5489-30ef-4718-ad6d-1126aaed9512 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086846 Dec 15 19:09:33.563493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 540/1025] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:09:33.569479 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ff5ace56-1fa4-4557-89b9-652e626c8888 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:33.578308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ff5ace56-1fa4-4557-89b9-652e626c8888 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:33.578308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ff5ace56-1fa4-4557-89b9-652e626c8888 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:33.578308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ff5ace56-1fa4-4557-89b9-652e626c8888 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:33.578308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ff5ace56-1fa4-4557-89b9-652e626c8888 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:33.578662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ff5ace56-1fa4-4557-89b9-652e626c8888 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:33.591958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-ff5ace56-1fa4-4557-89b9-652e626c8888 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] HTTP exception thrown: Instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 could not be found. Dec 15 19:09:33.592566 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ff5ace56-1fa4-4557-89b9-652e626c8888 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Returning 404 to user: Instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:09:33.593451 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ff5ace56-1fa4-4557-89b9-652e626c8888 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 404 len: 111 microversion: 2.1 time: 0.027458 Dec 15 19:09:33.601268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 486/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:33 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 19:09:33.692084 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-547120709", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-782438899", "security_groups": [{"name": "tempest-secgroup-smoke-39792596"}], "block_device_mapping_v2": [{"uuid": "01dcb8db-5185-4488-a524-e35ecda41417", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f1ee251-b588-424c-abec-a3e47c426719"}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:33.812752 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] validate_networks() for [('8f1ee251-b588-424c-abec-a3e47c426719', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:09:34.187364 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:09:34.187788 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:09:34.188258 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:09:34.188662 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:09:34.189064 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:09:34.197310 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:34.197915 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:34.198877 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:34.199328 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:34.200134 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:34.200560 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:34.203745 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:34.204191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:34.204965 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:34.205428 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:34.216829 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:09:34.220983 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for user b7c21b8f3da14074949d2f6ba58b7204 and project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:09:34.282811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:09:34.285253 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01dcb8db-5185-4488-a524-e35ecda41417',volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:09:34.342317 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:34.350119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:34.351624 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:34.352781 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d1486625-20b0-4fd7-b329-2a834211a891 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1744 microversion: 2.20 time: 0.159091 Dec 15 19:09:34.353378 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 487/1027] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:34 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:09:34.572478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a3cb6129-19a0-42e8-bafd-b77243458c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:34.573144 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a3cb6129-19a0-42e8-bafd-b77243458c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:34.579267 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a3cb6129-19a0-42e8-bafd-b77243458c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:34.579708 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a3cb6129-19a0-42e8-bafd-b77243458c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:34.580473 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a3cb6129-19a0-42e8-bafd-b77243458c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:34.580907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a3cb6129-19a0-42e8-bafd-b77243458c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:34.645740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4203fbaa-75df-4382-8578-3c15d3e61f70 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.957861 Dec 15 19:09:34.647235 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 541/1028] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:09:33 2021] POST /compute/v2.1/servers => generated 404 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:09:34.656075 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b1282f9c-78ca-4f67-bc60-065427335ff5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:34.656687 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b1282f9c-78ca-4f67-bc60-065427335ff5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:34.714844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b1282f9c-78ca-4f67-bc60-065427335ff5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:34.719627 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a3cb6129-19a0-42e8-bafd-b77243458c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:34.722965 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b1282f9c-78ca-4f67-bc60-065427335ff5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1093 microversion: 2.1 time: 0.070303 Dec 15 19:09:34.727257 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a3cb6129-19a0-42e8-bafd-b77243458c85 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1363 microversion: 2.1 time: 0.158311 Dec 15 19:09:34.727900 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 488/1029] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:34 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:34.732958 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 542/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:34 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:35.371297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:35.371901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:35.377945 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:35.379702 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:35.379702 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:35.379702 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:35.511100 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:35.518828 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:35.520917 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:35.522099 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-da146109-8853-439f-8cc9-996502fa9d3b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1744 microversion: 2.20 time: 0.154851 Dec 15 19:09:35.522648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 489/1031] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:35 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:35.739947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-02bd1fb5-530d-4f97-9c16-5d1d41b40e8c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:35.740821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-02bd1fb5-530d-4f97-9c16-5d1d41b40e8c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:35.743400 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b9435834-080d-4454-a3ea-e3b84289e088 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:35.744072 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b9435834-080d-4454-a3ea-e3b84289e088 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:35.748118 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-02bd1fb5-530d-4f97-9c16-5d1d41b40e8c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:35.748689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-02bd1fb5-530d-4f97-9c16-5d1d41b40e8c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:35.750022 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-02bd1fb5-530d-4f97-9c16-5d1d41b40e8c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:35.750022 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-02bd1fb5-530d-4f97-9c16-5d1d41b40e8c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:35.751391 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b9435834-080d-4454-a3ea-e3b84289e088 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:35.751840 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b9435834-080d-4454-a3ea-e3b84289e088 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:35.752631 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b9435834-080d-4454-a3ea-e3b84289e088 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:35.753069 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b9435834-080d-4454-a3ea-e3b84289e088 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:35.809955 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-02bd1fb5-530d-4f97-9c16-5d1d41b40e8c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:35.818063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-02bd1fb5-530d-4f97-9c16-5d1d41b40e8c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1143 microversion: 2.1 time: 0.082100 Dec 15 19:09:35.818728 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 543/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:35 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:35.886950 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b9435834-080d-4454-a3ea-e3b84289e088 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:35.894319 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b9435834-080d-4454-a3ea-e3b84289e088 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1549 microversion: 2.1 time: 0.154675 Dec 15 19:09:35.894887 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 490/1033] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:35 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:35.910800 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5e68d0e1-2ab8-46bc-aa94-3566ff3e3020 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:35.911791 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5e68d0e1-2ab8-46bc-aa94-3566ff3e3020 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:35.917516 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5e68d0e1-2ab8-46bc-aa94-3566ff3e3020 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:35.917968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5e68d0e1-2ab8-46bc-aa94-3566ff3e3020 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:35.918745 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5e68d0e1-2ab8-46bc-aa94-3566ff3e3020 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:35.919177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5e68d0e1-2ab8-46bc-aa94-3566ff3e3020 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:36.001656 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5e68d0e1-2ab8-46bc-aa94-3566ff3e3020 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094396 Dec 15 19:09:36.002262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 544/1034] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Dec 15 19:09:35 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:36.540402 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:36.541025 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:36.547120 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:36.548184 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:36.548453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:36.548893 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:36.825623 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:36.835506 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-dc65bbe9-680b-48db-a342-7e269eecf59b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:36.836422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-dc65bbe9-680b-48db-a342-7e269eecf59b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:36.840910 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:36.843998 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:36.844359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dc65bbe9-680b-48db-a342-7e269eecf59b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:36.844814 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dc65bbe9-680b-48db-a342-7e269eecf59b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:36.845635 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dc65bbe9-680b-48db-a342-7e269eecf59b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:36.846065 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b85bf94d-02d0-4ed4-a50c-5ea35b2a52d0 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.308674 Dec 15 19:09:36.846193 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dc65bbe9-680b-48db-a342-7e269eecf59b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:36.847093 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 491/1035] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:36 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:36.950836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-dc65bbe9-680b-48db-a342-7e269eecf59b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:36.958969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-dc65bbe9-680b-48db-a342-7e269eecf59b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1209 microversion: 2.1 time: 0.127813 Dec 15 19:09:36.959891 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 545/1036] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:36 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:37.415905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-beb62d6a-97c4-4546-8a58-9e36d0781179 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:37.416901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-beb62d6a-97c4-4546-8a58-9e36d0781179 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:37.433267 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-beb62d6a-97c4-4546-8a58-9e36d0781179 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:37.434647 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-68246623-6098-4af6-a1a7-72da16e64e1d req-b4fd0bc2-4a23-41b3-9c5b-674806e387ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633f7767-df32-4ca3-986c-07c1c0a517b7", "tag": "76e0bcfc-5319-45ee-ba0d-5566b3fc3537"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:37.436226 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:37.436226 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:37.440833 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-beb62d6a-97c4-4546-8a58-9e36d0781179 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:37.446151 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-beb62d6a-97c4-4546-8a58-9e36d0781179 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:37.446151 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-beb62d6a-97c4-4546-8a58-9e36d0781179 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:37.447672 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-68246623-6098-4af6-a1a7-72da16e64e1d req-b4fd0bc2-4a23-41b3-9c5b-674806e387ff service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:37.448128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-68246623-6098-4af6-a1a7-72da16e64e1d req-b4fd0bc2-4a23-41b3-9c5b-674806e387ff service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:37.484309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-68246623-6098-4af6-a1a7-72da16e64e1d req-b4fd0bc2-4a23-41b3-9c5b-674806e387ff service nova] Creating event network-changed:76e0bcfc-5319-45ee-ba0d-5566b3fc3537 for instance 633f7767-df32-4ca3-986c-07c1c0a517b7 on hv-cinder-81268 Dec 15 19:09:37.500886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-68246623-6098-4af6-a1a7-72da16e64e1d req-b4fd0bc2-4a23-41b3-9c5b-674806e387ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066868 Dec 15 19:09:37.504810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 546/1037] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:09:37.606418 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-beb62d6a-97c4-4546-8a58-9e36d0781179 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.194921 Dec 15 19:09:37.609771 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 492/1038] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:37 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:09:37.868474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:37.869378 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:37.889754 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:37.890209 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:37.895204 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:37.896694 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:37.980955 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d6fbb75b-32fb-42b1-be49-f71767a3b5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:37.982562 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d6fbb75b-32fb-42b1-be49-f71767a3b5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:37.993581 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d6fbb75b-32fb-42b1-be49-f71767a3b5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:37.994772 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d6fbb75b-32fb-42b1-be49-f71767a3b5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:37.995971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d6fbb75b-32fb-42b1-be49-f71767a3b5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:37.996632 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d6fbb75b-32fb-42b1-be49-f71767a3b5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:38.408692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:38.416953 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:38.428690 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:38.430127 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d9ed1006-3aef-433a-b326-2d2422ba2607 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.568349 Dec 15 19:09:38.430268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d6fbb75b-32fb-42b1-be49-f71767a3b5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:38.441481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 547/1039] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:37 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:38.451654 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d6fbb75b-32fb-42b1-be49-f71767a3b5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1275 microversion: 2.1 time: 0.475831 Dec 15 19:09:38.501301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 493/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:37 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1275 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:38.638944 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4d433ce3-ea0a-4e4c-94bf-76a6f4ef5b50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:38.639987 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4d433ce3-ea0a-4e4c-94bf-76a6f4ef5b50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:38.647286 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d433ce3-ea0a-4e4c-94bf-76a6f4ef5b50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:38.653674 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d433ce3-ea0a-4e4c-94bf-76a6f4ef5b50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:38.654510 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d433ce3-ea0a-4e4c-94bf-76a6f4ef5b50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:38.654949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4d433ce3-ea0a-4e4c-94bf-76a6f4ef5b50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:38.724593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4d433ce3-ea0a-4e4c-94bf-76a6f4ef5b50 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.090214 Dec 15 19:09:38.725334 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 548/1041] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:38 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:09:39.136464 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-4f9410f1-8fea-4819-a26d-9f6b33d033d8 req-b10f1171-904f-4f5f-84fd-fdcd15acc31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dc52f2-0172-444c-a81e-114b83f31ae5", "tag": "9aff0ec1-39e4-4928-bb44-ff2c56b1c255"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:39.140767 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:39.140767 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:09:39.149832 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-4f9410f1-8fea-4819-a26d-9f6b33d033d8 req-b10f1171-904f-4f5f-84fd-fdcd15acc31e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:39.151459 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-4f9410f1-8fea-4819-a26d-9f6b33d033d8 req-b10f1171-904f-4f5f-84fd-fdcd15acc31e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:39.170391 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-4f9410f1-8fea-4819-a26d-9f6b33d033d8 req-b10f1171-904f-4f5f-84fd-fdcd15acc31e service nova] Creating event network-changed:9aff0ec1-39e4-4928-bb44-ff2c56b1c255 for instance 74dc52f2-0172-444c-a81e-114b83f31ae5 on hv-cinder-81268 Dec 15 19:09:39.176864 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-4f9410f1-8fea-4819-a26d-9f6b33d033d8 req-b10f1171-904f-4f5f-84fd-fdcd15acc31e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044559 Dec 15 19:09:39.177599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 494/1042] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:39.449807 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:39.449807 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:39.458760 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:39.459230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:39.460005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:39.460433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:39.477822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7118d260-f6e6-463e-b188-09f04efe9221 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:39.479609 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7118d260-f6e6-463e-b188-09f04efe9221 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:39.501157 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7118d260-f6e6-463e-b188-09f04efe9221 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:39.502555 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7118d260-f6e6-463e-b188-09f04efe9221 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:39.503613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7118d260-f6e6-463e-b188-09f04efe9221 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:39.505470 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7118d260-f6e6-463e-b188-09f04efe9221 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:39.724391 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:39.735619 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:39.737138 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:39.739283 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e6b88d58-2b17-4c15-b14b-863d7b08d854 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.293869 Dec 15 19:09:39.763274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 549/1043] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:39 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:39.768409 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-1be5986b-9c51-40d4-b379-4146cfda8dac req-d9740b63-1db9-403f-8922-077e3920993a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8ea341-62ac-42cb-8ae6-b14554543d64", "name": "network-vif-plugged", "status": "completed", "tag": "b365bf51-9207-425f-b345-4f76d1e37689"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:39.770780 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:39.770780 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:39.790300 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-1be5986b-9c51-40d4-b379-4146cfda8dac req-d9740b63-1db9-403f-8922-077e3920993a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:39.791203 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-1be5986b-9c51-40d4-b379-4146cfda8dac req-d9740b63-1db9-403f-8922-077e3920993a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:39.816552 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-1be5986b-9c51-40d4-b379-4146cfda8dac req-d9740b63-1db9-403f-8922-077e3920993a service nova] Creating event network-vif-plugged:b365bf51-9207-425f-b345-4f76d1e37689 for instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 on hv-cinder-81268 Dec 15 19:09:39.833897 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-1be5986b-9c51-40d4-b379-4146cfda8dac req-d9740b63-1db9-403f-8922-077e3920993a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067298 Dec 15 19:09:39.834968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 550/1044] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:39.840549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-24791558-5573-415c-bb8e-f3921811fa48 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:39.841844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-24791558-5573-415c-bb8e-f3921811fa48 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:39.861467 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-24791558-5573-415c-bb8e-f3921811fa48 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:39.862338 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-24791558-5573-415c-bb8e-f3921811fa48 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:39.863387 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-24791558-5573-415c-bb8e-f3921811fa48 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:39.864172 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-24791558-5573-415c-bb8e-f3921811fa48 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:39.875374 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7118d260-f6e6-463e-b188-09f04efe9221 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:39.895843 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7118d260-f6e6-463e-b188-09f04efe9221 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.428482 Dec 15 19:09:39.908433 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 495/1045] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:39 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:39.951894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-24791558-5573-415c-bb8e-f3921811fa48 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.115301 Dec 15 19:09:39.953065 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 551/1046] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:39 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:09:40.758036 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:40.763289 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:40.770408 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:40.771065 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:40.772026 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:40.772712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:40.915768 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-45019bd0-e541-4901-a453-7093f9bf155e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:40.917149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-45019bd0-e541-4901-a453-7093f9bf155e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:40.923792 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:40.927022 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-45019bd0-e541-4901-a453-7093f9bf155e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:40.927635 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-45019bd0-e541-4901-a453-7093f9bf155e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:40.929146 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-45019bd0-e541-4901-a453-7093f9bf155e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:40.929739 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-45019bd0-e541-4901-a453-7093f9bf155e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:40.933459 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:40.935018 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:40.936229 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7ea9db49-021d-4c4c-be6c-6cc32978cdbb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.182093 Dec 15 19:09:40.937404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 496/1047] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:40 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:40.973517 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-81a46fd7-7807-4819-9f6c-4d1ee4414349 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:40.974658 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-81a46fd7-7807-4819-9f6c-4d1ee4414349 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:40.980985 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81a46fd7-7807-4819-9f6c-4d1ee4414349 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:40.981915 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81a46fd7-7807-4819-9f6c-4d1ee4414349 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:40.982388 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81a46fd7-7807-4819-9f6c-4d1ee4414349 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:40.982892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-81a46fd7-7807-4819-9f6c-4d1ee4414349 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:41.046548 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-81a46fd7-7807-4819-9f6c-4d1ee4414349 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.086564 Dec 15 19:09:41.047507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 497/1048] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:40 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:09:41.088529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-45019bd0-e541-4901-a453-7093f9bf155e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:41.095992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-45019bd0-e541-4901-a453-7093f9bf155e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.185892 Dec 15 19:09:41.096558 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 552/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:40 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:41.955463 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:41.956109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:41.963060 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:41.963509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:41.964292 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:41.964727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:42.060015 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ee6f1b74-b4e3-4337-874e-450a74bec910 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:42.060938 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ee6f1b74-b4e3-4337-874e-450a74bec910 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:42.074673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ee6f1b74-b4e3-4337-874e-450a74bec910 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:42.075366 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ee6f1b74-b4e3-4337-874e-450a74bec910 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:42.076340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ee6f1b74-b4e3-4337-874e-450a74bec910 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:42.076946 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ee6f1b74-b4e3-4337-874e-450a74bec910 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:42.122206 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:42.134544 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:42.136336 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:42.137540 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fce78831-601b-4c5a-a116-fe52622810dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.186288 Dec 15 19:09:42.140624 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 498/1050] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:41 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:42.152290 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-37614aa8-b8c4-437a-af9a-d362e7596bf4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:42.153327 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-37614aa8-b8c4-437a-af9a-d362e7596bf4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:42.159502 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37614aa8-b8c4-437a-af9a-d362e7596bf4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:42.159953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37614aa8-b8c4-437a-af9a-d362e7596bf4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:42.161192 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37614aa8-b8c4-437a-af9a-d362e7596bf4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:42.163410 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37614aa8-b8c4-437a-af9a-d362e7596bf4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:42.184617 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ee6f1b74-b4e3-4337-874e-450a74bec910 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.127147 Dec 15 19:09:42.185658 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 553/1051] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:42 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:09:42.324266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-37614aa8-b8c4-437a-af9a-d362e7596bf4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:42.332845 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-37614aa8-b8c4-437a-af9a-d362e7596bf4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.191649 Dec 15 19:09:42.332845 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 499/1052] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:42 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:43.162354 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:43.163124 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:43.170590 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:43.171104 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:43.171922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:43.172355 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:43.197503 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-119d2be9-f17c-45d0-ba7e-a8f377b2df93 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:43.199086 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-119d2be9-f17c-45d0-ba7e-a8f377b2df93 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:43.214448 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-119d2be9-f17c-45d0-ba7e-a8f377b2df93 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:43.215376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-119d2be9-f17c-45d0-ba7e-a8f377b2df93 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:43.216791 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-119d2be9-f17c-45d0-ba7e-a8f377b2df93 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:43.224301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-119d2be9-f17c-45d0-ba7e-a8f377b2df93 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:43.305034 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-119d2be9-f17c-45d0-ba7e-a8f377b2df93 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.112245 Dec 15 19:09:43.305905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 500/1053] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:43 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 19:09:43.354778 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-907f4e67-2692-4883-900b-2847f3ce34f3 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:43.355596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-907f4e67-2692-4883-900b-2847f3ce34f3 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:43.362752 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-907f4e67-2692-4883-900b-2847f3ce34f3 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:43.363295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-907f4e67-2692-4883-900b-2847f3ce34f3 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:43.364232 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-907f4e67-2692-4883-900b-2847f3ce34f3 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:43.364772 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-907f4e67-2692-4883-900b-2847f3ce34f3 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:43.369896 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:43.384247 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:43.386774 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:43.388298 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3c71f9c4-d91b-436e-ad2d-dd608e127a9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.232962 Dec 15 19:09:43.389197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 554/1054] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:43 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:43.551819 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-907f4e67-2692-4883-900b-2847f3ce34f3 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:43.561938 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-907f4e67-2692-4883-900b-2847f3ce34f3 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.210046 Dec 15 19:09:43.561938 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 501/1055] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:43 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:44.318119 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-04a50dbf-d84f-4a18-8557-31aa8d9dd36e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:44.319067 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-04a50dbf-d84f-4a18-8557-31aa8d9dd36e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:44.326139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-04a50dbf-d84f-4a18-8557-31aa8d9dd36e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:44.326595 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-04a50dbf-d84f-4a18-8557-31aa8d9dd36e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:44.327374 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-04a50dbf-d84f-4a18-8557-31aa8d9dd36e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:44.327812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-04a50dbf-d84f-4a18-8557-31aa8d9dd36e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:44.402573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-04a50dbf-d84f-4a18-8557-31aa8d9dd36e tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.087790 Dec 15 19:09:44.405983 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 555/1056] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:44 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 19:09:44.407849 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:44.408470 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:44.429055 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:44.429538 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:44.431019 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:44.431751 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:44.579582 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-677fab05-1dba-47a2-989d-d3e4e95a6b53 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:44.580309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-677fab05-1dba-47a2-989d-d3e4e95a6b53 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:44.587750 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-677fab05-1dba-47a2-989d-d3e4e95a6b53 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:44.588197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-677fab05-1dba-47a2-989d-d3e4e95a6b53 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:44.588979 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-677fab05-1dba-47a2-989d-d3e4e95a6b53 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:44.589564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-677fab05-1dba-47a2-989d-d3e4e95a6b53 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:44.653325 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:44.662410 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:44.664008 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:44.665429 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6e3d01ca-fc99-48d0-b158-d2ee233ba5a6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.261362 Dec 15 19:09:44.676155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 502/1057] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:44 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:44.756608 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-677fab05-1dba-47a2-989d-d3e4e95a6b53 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:44.767848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-677fab05-1dba-47a2-989d-d3e4e95a6b53 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.189679 Dec 15 19:09:44.777915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 556/1058] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:44 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:45.415117 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-58119867-9f84-4c67-aedf-f53625179be2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:45.415994 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-58119867-9f84-4c67-aedf-f53625179be2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:45.422879 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-58119867-9f84-4c67-aedf-f53625179be2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:45.423336 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-58119867-9f84-4c67-aedf-f53625179be2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:45.424125 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-58119867-9f84-4c67-aedf-f53625179be2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:45.424577 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-58119867-9f84-4c67-aedf-f53625179be2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:45.488200 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-58119867-9f84-4c67-aedf-f53625179be2 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.078107 Dec 15 19:09:45.492279 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 503/1059] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:45 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:09:45.683682 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:45.684472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:45.690693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:45.691147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:45.692455 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:45.692888 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:45.789763 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c524e2f3-c999-4e1b-b1c1-9b16c9336cf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:45.790692 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c524e2f3-c999-4e1b-b1c1-9b16c9336cf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:45.807466 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c524e2f3-c999-4e1b-b1c1-9b16c9336cf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:45.808320 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c524e2f3-c999-4e1b-b1c1-9b16c9336cf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:45.809375 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c524e2f3-c999-4e1b-b1c1-9b16c9336cf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:45.810053 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c524e2f3-c999-4e1b-b1c1-9b16c9336cf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:45.848549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:45.857074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:45.858598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:45.859746 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-34d777e1-a56e-40f4-a450-21565b8cbd3d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.179921 Dec 15 19:09:45.874866 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 557/1060] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:45 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:09:45.966295 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c524e2f3-c999-4e1b-b1c1-9b16c9336cf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:45.979560 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c524e2f3-c999-4e1b-b1c1-9b16c9336cf1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.197200 Dec 15 19:09:45.980378 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 504/1061] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:45 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:46.501399 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8452b927-dadd-47b8-a435-3d855772d669 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:46.502325 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8452b927-dadd-47b8-a435-3d855772d669 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:46.511319 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8452b927-dadd-47b8-a435-3d855772d669 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:46.511776 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8452b927-dadd-47b8-a435-3d855772d669 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:46.512606 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8452b927-dadd-47b8-a435-3d855772d669 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:46.513039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8452b927-dadd-47b8-a435-3d855772d669 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:46.583383 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8452b927-dadd-47b8-a435-3d855772d669 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.085917 Dec 15 19:09:46.584441 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 558/1062] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:46 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:09:46.878530 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:46.880299 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:46.888319 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:46.888752 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:46.889581 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:46.890016 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:47.000261 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1a6b923a-492b-41c7-81ad-7ce742ba934e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:47.000964 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1a6b923a-492b-41c7-81ad-7ce742ba934e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:47.008377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1a6b923a-492b-41c7-81ad-7ce742ba934e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:47.008833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1a6b923a-492b-41c7-81ad-7ce742ba934e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:47.009650 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1a6b923a-492b-41c7-81ad-7ce742ba934e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:47.010083 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1a6b923a-492b-41c7-81ad-7ce742ba934e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:47.040131 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:47.051575 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:47.053271 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:47.054730 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bf31867e-800b-43a0-9eb7-22cd9ac2f6c9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.179995 Dec 15 19:09:47.065943 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 505/1063] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:46 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:47.159481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1a6b923a-492b-41c7-81ad-7ce742ba934e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:47.167497 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1a6b923a-492b-41c7-81ad-7ce742ba934e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.173410 Dec 15 19:09:47.168105 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 559/1064] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:46 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:47.594005 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b61ba91a-efd3-4ec9-80fc-a6f75c60e377 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:47.594920 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b61ba91a-efd3-4ec9-80fc-a6f75c60e377 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:47.603725 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b61ba91a-efd3-4ec9-80fc-a6f75c60e377 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:47.604178 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b61ba91a-efd3-4ec9-80fc-a6f75c60e377 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:47.604981 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b61ba91a-efd3-4ec9-80fc-a6f75c60e377 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:47.605593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b61ba91a-efd3-4ec9-80fc-a6f75c60e377 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:47.668548 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b61ba91a-efd3-4ec9-80fc-a6f75c60e377 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 14 microversion: 2.1 time: 0.078127 Dec 15 19:09:47.669209 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 506/1065] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:47 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:09:48.074487 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:48.076000 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:48.083233 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:48.084000 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:48.084826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:48.085334 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:48.187166 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4687c4af-385c-4bf8-8583-e4b6ef57d6e7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:48.187872 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4687c4af-385c-4bf8-8583-e4b6ef57d6e7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:48.197263 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4687c4af-385c-4bf8-8583-e4b6ef57d6e7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:48.197718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4687c4af-385c-4bf8-8583-e4b6ef57d6e7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:48.203519 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4687c4af-385c-4bf8-8583-e4b6ef57d6e7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:48.204175 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4687c4af-385c-4bf8-8583-e4b6ef57d6e7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:48.256689 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:48.282125 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:48.284368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:48.286203 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1f88ddaa-066f-4e8b-94f6-a18fdaf87bb9 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.217174 Dec 15 19:09:48.291376 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 560/1066] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:48 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:48.379341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4687c4af-385c-4bf8-8583-e4b6ef57d6e7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:48.389871 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4687c4af-385c-4bf8-8583-e4b6ef57d6e7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.208468 Dec 15 19:09:48.393226 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 507/1067] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:48 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:48.679844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-aa258482-865a-4367-b091-676eb33d7f2f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:48.680757 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-aa258482-865a-4367-b091-676eb33d7f2f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:48.687084 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aa258482-865a-4367-b091-676eb33d7f2f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:48.687540 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aa258482-865a-4367-b091-676eb33d7f2f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:48.688318 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aa258482-865a-4367-b091-676eb33d7f2f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:48.688754 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-aa258482-865a-4367-b091-676eb33d7f2f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:48.760013 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-aa258482-865a-4367-b091-676eb33d7f2f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 7429 microversion: 2.1 time: 0.084306 Dec 15 19:09:48.760818 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 561/1068] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:48 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 7429 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:49.051769 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-80359172-8adf-4794-a0b6-80f1d2092c56 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:49.052735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-80359172-8adf-4794-a0b6-80f1d2092c56 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:49.058995 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-80359172-8adf-4794-a0b6-80f1d2092c56 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.059455 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-80359172-8adf-4794-a0b6-80f1d2092c56 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.060226 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-80359172-8adf-4794-a0b6-80f1d2092c56 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.060656 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-80359172-8adf-4794-a0b6-80f1d2092c56 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.287292 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-80359172-8adf-4794-a0b6-80f1d2092c56 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "POST /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/action" status: 202 len: 0 microversion: 2.1 time: 0.239783 Dec 15 19:09:49.288096 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 508/1069] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:49 2021] POST /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:09:49.296886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9c8a7a2a-f765-4db6-9cda-f471bf619492 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:49.301921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9c8a7a2a-f765-4db6-9cda-f471bf619492 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:49.304872 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:49.305601 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:49.305768 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c8a7a2a-f765-4db6-9cda-f471bf619492 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.306143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c8a7a2a-f765-4db6-9cda-f471bf619492 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.307133 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c8a7a2a-f765-4db6-9cda-f471bf619492 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.307561 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9c8a7a2a-f765-4db6-9cda-f471bf619492 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.311724 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.312174 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.312956 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.313438 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.470104 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9c8a7a2a-f765-4db6-9cda-f471bf619492 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:49.478610 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9c8a7a2a-f765-4db6-9cda-f471bf619492 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1753 microversion: 2.1 time: 0.186080 Dec 15 19:09:49.479403 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 562/1070] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:49 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:49.486320 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-15cf8c10-a434-4537-90e7-d9f1cc7414eb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:49.486320 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-15cf8c10-a434-4537-90e7-d9f1cc7414eb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:49.491872 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-15cf8c10-a434-4537-90e7-d9f1cc7414eb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.492329 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-15cf8c10-a434-4537-90e7-d9f1cc7414eb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.493334 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-15cf8c10-a434-4537-90e7-d9f1cc7414eb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.494533 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-15cf8c10-a434-4537-90e7-d9f1cc7414eb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.503238 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:49.514181 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:49.516997 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:49.518638 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d51a6a79-d856-4443-ab33-89d5ccbaef4b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1739 microversion: 2.20 time: 0.218501 Dec 15 19:09:49.520325 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 509/1071] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:49 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:09:49.636679 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-15cf8c10-a434-4537-90e7-d9f1cc7414eb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:49.657106 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-15cf8c10-a434-4537-90e7-d9f1cc7414eb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.176502 Dec 15 19:09:49.658012 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 563/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:49 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:49.770860 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6ad559b3-564e-4f0e-aa0b-b2e4602eddda tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:49.771826 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6ad559b3-564e-4f0e-aa0b-b2e4602eddda tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:49.777757 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ad559b3-564e-4f0e-aa0b-b2e4602eddda tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.778216 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ad559b3-564e-4f0e-aa0b-b2e4602eddda tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.779010 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ad559b3-564e-4f0e-aa0b-b2e4602eddda tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:49.779444 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6ad559b3-564e-4f0e-aa0b-b2e4602eddda tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:49.854941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6ad559b3-564e-4f0e-aa0b-b2e4602eddda tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 15025 microversion: 2.1 time: 0.088181 Dec 15 19:09:49.855634 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 510/1073] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:49 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 15025 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:09:50.497274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8ca2a895-925c-4fc7-a57d-824b0ebf568d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:50.497822 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8ca2a895-925c-4fc7-a57d-824b0ebf568d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:50.504072 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8ca2a895-925c-4fc7-a57d-824b0ebf568d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:50.504519 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8ca2a895-925c-4fc7-a57d-824b0ebf568d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:50.505326 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8ca2a895-925c-4fc7-a57d-824b0ebf568d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:50.505764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8ca2a895-925c-4fc7-a57d-824b0ebf568d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:50.544163 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:50.544908 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:50.552276 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:50.552726 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:50.553577 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:50.554019 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:50.649731 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8ca2a895-925c-4fc7-a57d-824b0ebf568d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:50.657785 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8ca2a895-925c-4fc7-a57d-824b0ebf568d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.164554 Dec 15 19:09:50.658359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 564/1074] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:50 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:50.674930 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7d67ae0f-c0b9-4899-98bc-440da3d0f54a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:50.675660 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7d67ae0f-c0b9-4899-98bc-440da3d0f54a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:50.681437 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d67ae0f-c0b9-4899-98bc-440da3d0f54a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:50.681887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d67ae0f-c0b9-4899-98bc-440da3d0f54a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:50.682669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d67ae0f-c0b9-4899-98bc-440da3d0f54a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:50.683106 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d67ae0f-c0b9-4899-98bc-440da3d0f54a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:50.689906 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:50.698247 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:50.699755 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:50.700899 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ccd39d0e-f4bc-43b6-a213-c6aab1a3f036 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1721 microversion: 2.20 time: 0.160867 Dec 15 19:09:50.701485 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 511/1075] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:50 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:09:50.810881 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7d67ae0f-c0b9-4899-98bc-440da3d0f54a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:50.818575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7d67ae0f-c0b9-4899-98bc-440da3d0f54a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.147211 Dec 15 19:09:50.819148 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 565/1076] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:50 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:50.866413 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e4fcc186-f29d-4bc4-8639-d8a2cf7598fe tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:50.867322 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e4fcc186-f29d-4bc4-8639-d8a2cf7598fe tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:50.873894 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e4fcc186-f29d-4bc4-8639-d8a2cf7598fe tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:50.874346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e4fcc186-f29d-4bc4-8639-d8a2cf7598fe tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:50.875128 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e4fcc186-f29d-4bc4-8639-d8a2cf7598fe tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:50.875567 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e4fcc186-f29d-4bc4-8639-d8a2cf7598fe tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:50.945115 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e4fcc186-f29d-4bc4-8639-d8a2cf7598fe tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 18030 microversion: 2.1 time: 0.082457 Dec 15 19:09:50.945869 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 512/1077] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:50 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 18030 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:09:51.579917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-5e4565a1-4c4e-4641-9a43-626fc42d1676 req-b7d001cc-eb1a-4b22-98d7-9e5b6e9ba6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dc52f2-0172-444c-a81e-114b83f31ae5", "name": "network-vif-plugged", "status": "completed", "tag": "9aff0ec1-39e4-4928-bb44-ff2c56b1c255"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:51.581597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:51.581597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:51.588969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-5e4565a1-4c4e-4641-9a43-626fc42d1676 req-b7d001cc-eb1a-4b22-98d7-9e5b6e9ba6e5 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:51.589235 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-5e4565a1-4c4e-4641-9a43-626fc42d1676 req-b7d001cc-eb1a-4b22-98d7-9e5b6e9ba6e5 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:51.601628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-5e4565a1-4c4e-4641-9a43-626fc42d1676 req-b7d001cc-eb1a-4b22-98d7-9e5b6e9ba6e5 service nova] Creating event network-vif-plugged:9aff0ec1-39e4-4928-bb44-ff2c56b1c255 for instance 74dc52f2-0172-444c-a81e-114b83f31ae5 on hv-cinder-81268 Dec 15 19:09:51.606367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-5e4565a1-4c4e-4641-9a43-626fc42d1676 req-b7d001cc-eb1a-4b22-98d7-9e5b6e9ba6e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030130 Dec 15 19:09:51.611616 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 566/1078] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:51.676411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c527880f-6584-4869-9915-025c7c2420ed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:51.677147 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c527880f-6584-4869-9915-025c7c2420ed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:51.684045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c527880f-6584-4869-9915-025c7c2420ed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:51.684498 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c527880f-6584-4869-9915-025c7c2420ed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:51.685370 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c527880f-6584-4869-9915-025c7c2420ed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:51.685813 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c527880f-6584-4869-9915-025c7c2420ed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:51.720681 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:51.721804 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:51.729304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:51.730094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:51.731452 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:51.732111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:51.861340 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c527880f-6584-4869-9915-025c7c2420ed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:51.870189 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c527880f-6584-4869-9915-025c7c2420ed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.198309 Dec 15 19:09:51.870788 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 513/1079] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:51 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:51.875180 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e7a8cc6a-a4d9-45f7-bf3b-83c598c72e09 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:51.875794 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e7a8cc6a-a4d9-45f7-bf3b-83c598c72e09 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:51.882820 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7a8cc6a-a4d9-45f7-bf3b-83c598c72e09 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:51.883274 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7a8cc6a-a4d9-45f7-bf3b-83c598c72e09 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:51.884069 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7a8cc6a-a4d9-45f7-bf3b-83c598c72e09 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:51.884505 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7a8cc6a-a4d9-45f7-bf3b-83c598c72e09 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:52.037246 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e7a8cc6a-a4d9-45f7-bf3b-83c598c72e09 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:52.044486 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e7a8cc6a-a4d9-45f7-bf3b-83c598c72e09 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.172718 Dec 15 19:09:52.045056 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 514/1080] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:51 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:52.051658 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5e44dcba-64dc-4e22-8c3c-148b325d018d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:52.051658 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5e44dcba-64dc-4e22-8c3c-148b325d018d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:52.058988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e44dcba-64dc-4e22-8c3c-148b325d018d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:52.059456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e44dcba-64dc-4e22-8c3c-148b325d018d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:52.060281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e44dcba-64dc-4e22-8c3c-148b325d018d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:52.060730 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e44dcba-64dc-4e22-8c3c-148b325d018d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:52.098594 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:52.106572 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:52.110301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:52.110301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8b8d2611-af9c-4970-a848-2056355af068 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1721 microversion: 2.20 time: 0.392666 Dec 15 19:09:52.110301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 567/1081] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:51 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1721 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:09:52.330047 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5e44dcba-64dc-4e22-8c3c-148b325d018d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 19446 microversion: 2.1 time: 0.283650 Dec 15 19:09:52.330918 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 515/1082] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:52 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 19446 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:09:52.886896 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c3a2c703-d1cc-4d6c-97dd-b9c8c4909c48 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:52.887482 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c3a2c703-d1cc-4d6c-97dd-b9c8c4909c48 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:52.893803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c3a2c703-d1cc-4d6c-97dd-b9c8c4909c48 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:52.894887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c3a2c703-d1cc-4d6c-97dd-b9c8c4909c48 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:52.895673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c3a2c703-d1cc-4d6c-97dd-b9c8c4909c48 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:52.896109 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c3a2c703-d1cc-4d6c-97dd-b9c8c4909c48 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.040089 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c3a2c703-d1cc-4d6c-97dd-b9c8c4909c48 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:53.047826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c3a2c703-d1cc-4d6c-97dd-b9c8c4909c48 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.164620 Dec 15 19:09:53.048377 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 568/1083] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:52 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:53.067791 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0d6df19b-269f-46f8-acaa-a66753cb6b69 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:53.068491 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0d6df19b-269f-46f8-acaa-a66753cb6b69 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:53.075380 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0d6df19b-269f-46f8-acaa-a66753cb6b69 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:53.075861 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0d6df19b-269f-46f8-acaa-a66753cb6b69 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.076672 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0d6df19b-269f-46f8-acaa-a66753cb6b69 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:53.077126 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0d6df19b-269f-46f8-acaa-a66753cb6b69 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.127526 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:53.128289 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:53.135005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:53.135460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.136304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:53.136742 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.214456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0d6df19b-269f-46f8-acaa-a66753cb6b69 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:53.221979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0d6df19b-269f-46f8-acaa-a66753cb6b69 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1263 microversion: 2.1 time: 0.158685 Dec 15 19:09:53.222542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 516/1084] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:53 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:53.271018 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:53.278678 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:53.280184 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:53.281363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-01dde02c-cbbc-4857-b4f1-8e769f51cf7a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1664 microversion: 2.20 time: 0.157557 Dec 15 19:09:53.281914 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 569/1085] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:53 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:09:53.302744 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d4ef9b30-22d1-4883-b25e-db7a8def8593 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6d6ef0f-cf22-47e0-8f96-65bc3b647d1a"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:53.303778 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d4ef9b30-22d1-4883-b25e-db7a8def8593 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:53.309575 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4ef9b30-22d1-4883-b25e-db7a8def8593 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:53.310018 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4ef9b30-22d1-4883-b25e-db7a8def8593 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.310784 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4ef9b30-22d1-4883-b25e-db7a8def8593 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:53.311213 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4ef9b30-22d1-4883-b25e-db7a8def8593 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.342262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fb6f9b25-2857-4321-b11e-b485b689d3b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:53.343213 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fb6f9b25-2857-4321-b11e-b485b689d3b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:53.349143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb6f9b25-2857-4321-b11e-b485b689d3b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:53.349593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb6f9b25-2857-4321-b11e-b485b689d3b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.350383 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb6f9b25-2857-4321-b11e-b485b689d3b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:53.350798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fb6f9b25-2857-4321-b11e-b485b689d3b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.444823 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fb6f9b25-2857-4321-b11e-b485b689d3b9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 21966 microversion: 2.1 time: 0.106445 Dec 15 19:09:53.445426 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 570/1086] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:53 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 21966 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 19:09:53.623421 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-08591932-76cf-4047-add6-9b0d9d799297 req-9791143d-ca92-4d27-bf31-ce610e75af28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8ea341-62ac-42cb-8ae6-b14554543d64", "name": "network-vif-unplugged", "status": "completed", "tag": "b365bf51-9207-425f-b345-4f76d1e37689"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:53.624904 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:53.624904 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:53.633349 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-08591932-76cf-4047-add6-9b0d9d799297 req-9791143d-ca92-4d27-bf31-ce610e75af28 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:53.636827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-08591932-76cf-4047-add6-9b0d9d799297 req-9791143d-ca92-4d27-bf31-ce610e75af28 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:53.644876 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.compute.server_external_events [req-08591932-76cf-4047-add6-9b0d9d799297 req-9791143d-ca92-4d27-bf31-ce610e75af28 service nova] Unable to find a host for instance 2a8ea341-62ac-42cb-8ae6-b14554543d64. Dropping event network-vif-unplugged {{(pid=116514) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 19:09:53.645763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-08591932-76cf-4047-add6-9b0d9d799297 req-9791143d-ca92-4d27-bf31-ce610e75af28 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027421 Dec 15 19:09:53.646327 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 571/1087] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:53 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 15 19:09:54.069433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-da7f6982-b9c8-415e-9fd4-891f773f0693 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:54.070086 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-da7f6982-b9c8-415e-9fd4-891f773f0693 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:54.076643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-da7f6982-b9c8-415e-9fd4-891f773f0693 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.077109 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-da7f6982-b9c8-415e-9fd4-891f773f0693 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.077956 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-da7f6982-b9c8-415e-9fd4-891f773f0693 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.078390 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-da7f6982-b9c8-415e-9fd4-891f773f0693 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.220490 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-da7f6982-b9c8-415e-9fd4-891f773f0693 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:54.228967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-da7f6982-b9c8-415e-9fd4-891f773f0693 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.167658 Dec 15 19:09:54.229574 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 572/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:54 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:54.234015 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d4ef9b30-22d1-4883-b25e-db7a8def8593 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.935349 Dec 15 19:09:54.234499 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 517/1089] 10.222.0.49 () {62 vars in 1363 bytes} [Wed Dec 15 19:09:53 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/os-volume_attachments => generated 188 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:09:54.238562 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c5e8346d-9b9b-4105-a373-63aad8f432f4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:54.239357 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c5e8346d-9b9b-4105-a373-63aad8f432f4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:54.254773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5e8346d-9b9b-4105-a373-63aad8f432f4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.254773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5e8346d-9b9b-4105-a373-63aad8f432f4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.254773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5e8346d-9b9b-4105-a373-63aad8f432f4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.254773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c5e8346d-9b9b-4105-a373-63aad8f432f4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.348020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-25a1b4b3-7559-44a2-9b63-9e19f9474dfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:54.348707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-25a1b4b3-7559-44a2-9b63-9e19f9474dfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:54.355297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-25a1b4b3-7559-44a2-9b63-9e19f9474dfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.355805 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-25a1b4b3-7559-44a2-9b63-9e19f9474dfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.356858 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-25a1b4b3-7559-44a2-9b63-9e19f9474dfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.357099 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-25a1b4b3-7559-44a2-9b63-9e19f9474dfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.385927 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c5e8346d-9b9b-4105-a373-63aad8f432f4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:54.393368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c5e8346d-9b9b-4105-a373-63aad8f432f4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1449 microversion: 2.1 time: 0.158361 Dec 15 19:09:54.394686 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 573/1090] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:54 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:54.409740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-49411ba0-5055-4226-bdd6-1fc754e31951 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:54.412434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-49411ba0-5055-4226-bdd6-1fc754e31951 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:54.420037 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-49411ba0-5055-4226-bdd6-1fc754e31951 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.420488 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-49411ba0-5055-4226-bdd6-1fc754e31951 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.421301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-49411ba0-5055-4226-bdd6-1fc754e31951 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.421736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-49411ba0-5055-4226-bdd6-1fc754e31951 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.554009 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-49411ba0-5055-4226-bdd6-1fc754e31951 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:54.561350 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-49411ba0-5055-4226-bdd6-1fc754e31951 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1449 microversion: 2.1 time: 0.155062 Dec 15 19:09:54.561905 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 574/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:54 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:54.566762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2ab3c2db-5055-49f3-b216-d5beb950de3b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:54.567694 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2ab3c2db-5055-49f3-b216-d5beb950de3b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:54.573170 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2ab3c2db-5055-49f3-b216-d5beb950de3b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.574768 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2ab3c2db-5055-49f3-b216-d5beb950de3b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.575645 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2ab3c2db-5055-49f3-b216-d5beb950de3b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.576088 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2ab3c2db-5055-49f3-b216-d5beb950de3b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.649653 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2ab3c2db-5055-49f3-b216-d5beb950de3b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 23597 microversion: 2.1 time: 0.086493 Dec 15 19:09:54.650328 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 575/1092] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:54 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 23597 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:09:54.896697 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-25a1b4b3-7559-44a2-9b63-9e19f9474dfe tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/os-volume_attachments/d6d6ef0f-cf22-47e0-8f96-65bc3b647d1a" status: 202 len: 0 microversion: 2.20 time: 0.552981 Dec 15 19:09:54.897255 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 518/1093] 10.222.0.49 () {60 vars in 1456 bytes} [Wed Dec 15 19:09:54 2021] DELETE /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/os-volume_attachments/d6d6ef0f-cf22-47e0-8f96-65bc3b647d1a => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 19:09:54.952112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0a3f3dcf-13ab-4342-9ad7-068dfaf092ff tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:54.952771 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0a3f3dcf-13ab-4342-9ad7-068dfaf092ff tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:54.960016 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a3f3dcf-13ab-4342-9ad7-068dfaf092ff tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.960459 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a3f3dcf-13ab-4342-9ad7-068dfaf092ff tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:54.961262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a3f3dcf-13ab-4342-9ad7-068dfaf092ff tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:54.961692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0a3f3dcf-13ab-4342-9ad7-068dfaf092ff tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:55.187678 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0a3f3dcf-13ab-4342-9ad7-068dfaf092ff tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action" status: 202 len: 0 microversion: 2.20 time: 0.239438 Dec 15 19:09:55.191807 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 576/1094] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Dec 15 19:09:54 2021] POST /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:09:55.196614 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:55.198298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:55.207708 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:55.208444 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:55.209518 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:55.210203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:55.246990 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d4e05363-60f7-4c7d-a812-0d9e8dc30bed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:55.247655 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d4e05363-60f7-4c7d-a812-0d9e8dc30bed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:55.255820 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d4e05363-60f7-4c7d-a812-0d9e8dc30bed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:55.256264 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d4e05363-60f7-4c7d-a812-0d9e8dc30bed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:55.257046 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d4e05363-60f7-4c7d-a812-0d9e8dc30bed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:55.257673 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d4e05363-60f7-4c7d-a812-0d9e8dc30bed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:55.432457 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d4e05363-60f7-4c7d-a812-0d9e8dc30bed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:55.442479 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d4e05363-60f7-4c7d-a812-0d9e8dc30bed tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.199608 Dec 15 19:09:55.443546 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 577/1095] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:55 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:09:55.564611 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:55.573289 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:55.574845 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:55.576056 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c2bb6f50-a0b6-4a74-81fc-da58ecf52efa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1672 microversion: 2.20 time: 0.383000 Dec 15 19:09:55.576815 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 519/1096] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:55 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1672 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:55.661259 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-254c7f93-825f-4a08-91ad-52a798ccfb54 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:55.662159 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-254c7f93-825f-4a08-91ad-52a798ccfb54 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:55.668259 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-254c7f93-825f-4a08-91ad-52a798ccfb54 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:55.668755 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-254c7f93-825f-4a08-91ad-52a798ccfb54 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:55.669575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-254c7f93-825f-4a08-91ad-52a798ccfb54 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:55.669989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-254c7f93-825f-4a08-91ad-52a798ccfb54 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:55.742880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-254c7f93-825f-4a08-91ad-52a798ccfb54 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 25134 microversion: 2.1 time: 0.085179 Dec 15 19:09:55.744001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 578/1097] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:55 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 25134 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:09:56.459556 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-806f9e4a-0f43-4e58-9e73-34ee4f70e776 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:56.460254 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-806f9e4a-0f43-4e58-9e73-34ee4f70e776 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:56.466858 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-806f9e4a-0f43-4e58-9e73-34ee4f70e776 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:56.467304 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-806f9e4a-0f43-4e58-9e73-34ee4f70e776 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:56.468081 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-806f9e4a-0f43-4e58-9e73-34ee4f70e776 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:56.468517 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-806f9e4a-0f43-4e58-9e73-34ee4f70e776 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:56.595168 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:56.596059 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:56.604359 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:56.604913 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:56.605820 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:56.606617 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:56.718647 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-806f9e4a-0f43-4e58-9e73-34ee4f70e776 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:56.727737 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-806f9e4a-0f43-4e58-9e73-34ee4f70e776 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.271778 Dec 15 19:09:56.728330 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 520/1098] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:56 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:56.753341 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:56.756173 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ea19149e-f3f1-42ad-9c6b-61f0da98276f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:56.757595 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ea19149e-f3f1-42ad-9c6b-61f0da98276f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:56.761707 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:56.764525 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:56.764752 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ea19149e-f3f1-42ad-9c6b-61f0da98276f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:56.764861 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4ff23db7-6b5c-4b25-a913-08a8be0bbd26 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1674 microversion: 2.20 time: 0.173378 Dec 15 19:09:56.764968 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ea19149e-f3f1-42ad-9c6b-61f0da98276f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:56.765268 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 579/1099] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:56 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:09:56.766060 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ea19149e-f3f1-42ad-9c6b-61f0da98276f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:56.766498 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ea19149e-f3f1-42ad-9c6b-61f0da98276f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:56.848568 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ea19149e-f3f1-42ad-9c6b-61f0da98276f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 26664 microversion: 2.1 time: 0.095971 Dec 15 19:09:56.856158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 521/1100] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:56 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 26664 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:09:56.962519 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-082ba1c8-7b19-4f92-8516-5bc57d9de8c2 req-78d5f506-936e-4d4c-99c3-677fa42f89b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dc52f2-0172-444c-a81e-114b83f31ae5", "tag": "9aff0ec1-39e4-4928-bb44-ff2c56b1c255"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:56.964087 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:09:56.964087 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:09:56.972652 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-082ba1c8-7b19-4f92-8516-5bc57d9de8c2 req-78d5f506-936e-4d4c-99c3-677fa42f89b5 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:56.973108 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-082ba1c8-7b19-4f92-8516-5bc57d9de8c2 req-78d5f506-936e-4d4c-99c3-677fa42f89b5 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:56.983115 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-082ba1c8-7b19-4f92-8516-5bc57d9de8c2 req-78d5f506-936e-4d4c-99c3-677fa42f89b5 service nova] Creating event network-changed:9aff0ec1-39e4-4928-bb44-ff2c56b1c255 for instance 74dc52f2-0172-444c-a81e-114b83f31ae5 on hv-cinder-81268 Dec 15 19:09:56.988708 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-082ba1c8-7b19-4f92-8516-5bc57d9de8c2 req-78d5f506-936e-4d4c-99c3-677fa42f89b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029253 Dec 15 19:09:56.989523 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 580/1101] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:09:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:09:57.745967 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9dafbceb-e260-42e5-ae7f-7c787116b319 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:57.746835 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9dafbceb-e260-42e5-ae7f-7c787116b319 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:57.754121 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9dafbceb-e260-42e5-ae7f-7c787116b319 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:57.754674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9dafbceb-e260-42e5-ae7f-7c787116b319 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:57.755562 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9dafbceb-e260-42e5-ae7f-7c787116b319 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:57.756105 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9dafbceb-e260-42e5-ae7f-7c787116b319 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:57.786541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:57.799576 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:57.807059 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:57.807793 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:57.808593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:57.809039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:57.936262 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9dafbceb-e260-42e5-ae7f-7c787116b319 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:57.944943 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9dafbceb-e260-42e5-ae7f-7c787116b319 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.203189 Dec 15 19:09:57.955880 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 522/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:57 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:57.961806 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c19d95a0-d6bc-4e69-bb93-fd380a787c63 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:57.963831 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c19d95a0-d6bc-4e69-bb93-fd380a787c63 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:57.964340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:57.973100 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c19d95a0-d6bc-4e69-bb93-fd380a787c63 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:57.973293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:57.973577 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c19d95a0-d6bc-4e69-bb93-fd380a787c63 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:57.974384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c19d95a0-d6bc-4e69-bb93-fd380a787c63 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:57.975061 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c19d95a0-d6bc-4e69-bb93-fd380a787c63 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:57.975391 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:57.976549 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1cab6478-f5a5-4167-899b-16deb81198aa tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.197774 Dec 15 19:09:57.977347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 581/1103] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:57 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:09:58.063257 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c19d95a0-d6bc-4e69-bb93-fd380a787c63 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 27645 microversion: 2.1 time: 0.105587 Dec 15 19:09:58.063936 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 523/1104] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:57 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 27645 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:09:58.962825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bee8bbcb-d2d9-42ea-98e9-70b9ae9b3981 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:58.963656 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bee8bbcb-d2d9-42ea-98e9-70b9ae9b3981 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:58.970868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bee8bbcb-d2d9-42ea-98e9-70b9ae9b3981 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:58.971313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bee8bbcb-d2d9-42ea-98e9-70b9ae9b3981 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:58.972848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bee8bbcb-d2d9-42ea-98e9-70b9ae9b3981 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:58.973575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bee8bbcb-d2d9-42ea-98e9-70b9ae9b3981 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:58.998504 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:09:58.999930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:59.006941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:59.007441 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:59.008231 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:59.008660 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:59.156439 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:59.164363 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:59.164793 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bee8bbcb-d2d9-42ea-98e9-70b9ae9b3981 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:59.165897 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:09:59.167189 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5142e46f-3254-457b-89e5-4004dbe31271 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.172988 Dec 15 19:09:59.167743 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 524/1105] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:09:58 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:09:59.173127 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bee8bbcb-d2d9-42ea-98e9-70b9ae9b3981 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.214118 Dec 15 19:09:59.174070 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 582/1106] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:09:58 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:09:59.185865 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8c1c23fd-e12c-4c12-869b-be2b51387c70 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:09:59.186798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8c1c23fd-e12c-4c12-869b-be2b51387c70 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:09:59.193719 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c1c23fd-e12c-4c12-869b-be2b51387c70 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:59.194176 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c1c23fd-e12c-4c12-869b-be2b51387c70 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:09:59.194977 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c1c23fd-e12c-4c12-869b-be2b51387c70 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:09:59.195423 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8c1c23fd-e12c-4c12-869b-be2b51387c70 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:00.185752 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:00.186503 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:00.194618 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:00.195070 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:00.195880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:00.196303 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:00.334934 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:00.343717 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:00.345342 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:00.346499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6c644a02-6bd8-412f-b9d2-9b71cb73379b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.164569 Dec 15 19:10:00.347104 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 583/1107] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:00 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:10:00.351274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0c0af62b-b253-4809-a1a5-7f87bc612ad7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:00.351882 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0c0af62b-b253-4809-a1a5-7f87bc612ad7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:00.357804 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c0af62b-b253-4809-a1a5-7f87bc612ad7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:00.358258 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c0af62b-b253-4809-a1a5-7f87bc612ad7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:00.359045 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c0af62b-b253-4809-a1a5-7f87bc612ad7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:00.359477 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0c0af62b-b253-4809-a1a5-7f87bc612ad7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:00.510695 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0c0af62b-b253-4809-a1a5-7f87bc612ad7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:00.518711 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0c0af62b-b253-4809-a1a5-7f87bc612ad7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.170604 Dec 15 19:10:00.519295 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 584/1108] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:00 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:01.366094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:01.366838 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:01.373675 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:01.375614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:01.375614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:01.375614 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:01.526183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:01.535422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:01.536947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:01.538135 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1831b273-7b39-40fa-990c-dff3a79c96bd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.175840 Dec 15 19:10:01.538693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 585/1109] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:01 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:10:01.543005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-651dbdde-65f1-4cf4-82df-f00b3e43ba71 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:01.543609 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-651dbdde-65f1-4cf4-82df-f00b3e43ba71 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:01.549598 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-651dbdde-65f1-4cf4-82df-f00b3e43ba71 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:01.550643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-651dbdde-65f1-4cf4-82df-f00b3e43ba71 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:01.551429 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-651dbdde-65f1-4cf4-82df-f00b3e43ba71 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:01.551868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-651dbdde-65f1-4cf4-82df-f00b3e43ba71 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:01.708990 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-651dbdde-65f1-4cf4-82df-f00b3e43ba71 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:01.717228 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-651dbdde-65f1-4cf4-82df-f00b3e43ba71 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.177513 Dec 15 19:10:01.718032 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 586/1110] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:01 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:02.556234 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:02.556949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:02.563122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:02.563564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:02.564332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:02.564759 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:02.701566 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:02.710021 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:02.711529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:02.712690 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-87001a2a-724b-434a-82c0-1251ab71ce6b tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.160370 Dec 15 19:10:02.713489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 587/1111] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:02 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:10:02.735108 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-89d6845f-51ae-47b1-b108-bcd386d3285d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:02.735728 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-89d6845f-51ae-47b1-b108-bcd386d3285d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:02.743454 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89d6845f-51ae-47b1-b108-bcd386d3285d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:02.743916 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89d6845f-51ae-47b1-b108-bcd386d3285d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:02.744725 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89d6845f-51ae-47b1-b108-bcd386d3285d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:02.745197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-89d6845f-51ae-47b1-b108-bcd386d3285d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:02.894504 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-89d6845f-51ae-47b1-b108-bcd386d3285d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:02.902825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-89d6845f-51ae-47b1-b108-bcd386d3285d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.171409 Dec 15 19:10:02.903395 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 588/1112] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:02 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:10:03.767216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:03.767216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:03.767216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:03.767216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:03.768902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:03.768902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:03.883053 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:03.891380 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:03.892888 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:03.894586 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1e15983f-2865-407e-ad45-e601be361496 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.166403 Dec 15 19:10:03.895149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 589/1113] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:03 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:03.923538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8f326025-263f-4f7a-b485-5844586ab754 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:03.924272 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8f326025-263f-4f7a-b485-5844586ab754 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:03.930709 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8f326025-263f-4f7a-b485-5844586ab754 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:03.931366 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8f326025-263f-4f7a-b485-5844586ab754 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:03.932417 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8f326025-263f-4f7a-b485-5844586ab754 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:03.932854 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8f326025-263f-4f7a-b485-5844586ab754 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:04.085478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8f326025-263f-4f7a-b485-5844586ab754 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:04.093864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8f326025-263f-4f7a-b485-5844586ab754 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.175592 Dec 15 19:10:04.094430 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 590/1114] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:03 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:04.912638 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:04.913471 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:04.920430 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:04.920983 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:04.922167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:04.922664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:05.064733 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:05.073050 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:05.074601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:05.075748 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-75f42941-6ef8-4aba-ba7e-e901b3a81bf3 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.166872 Dec 15 19:10:05.076306 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 591/1115] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:04 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:10:05.126668 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e34a85db-d3db-41e5-8c1f-b303b624a83c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:05.127309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e34a85db-d3db-41e5-8c1f-b303b624a83c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:05.133855 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e34a85db-d3db-41e5-8c1f-b303b624a83c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:05.134521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e34a85db-d3db-41e5-8c1f-b303b624a83c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:05.135498 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e34a85db-d3db-41e5-8c1f-b303b624a83c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:05.135949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e34a85db-d3db-41e5-8c1f-b303b624a83c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:05.285566 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e34a85db-d3db-41e5-8c1f-b303b624a83c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:05.294512 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e34a85db-d3db-41e5-8c1f-b303b624a83c tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.171590 Dec 15 19:10:05.295078 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 592/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:05 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:10:06.094575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:06.095578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:06.102157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:06.102632 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:06.103457 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:06.103884 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:06.248166 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:06.256565 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:06.258122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:06.259419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3d429aa0-879a-46cf-8123-756622c57f15 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.168626 Dec 15 19:10:06.260069 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 593/1117] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:06 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:10:06.311476 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-383961b2-bfee-494a-beaa-8db7702d03ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:06.312083 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-383961b2-bfee-494a-beaa-8db7702d03ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:06.318051 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-383961b2-bfee-494a-beaa-8db7702d03ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:06.318501 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-383961b2-bfee-494a-beaa-8db7702d03ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:06.319275 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-383961b2-bfee-494a-beaa-8db7702d03ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:06.319721 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-383961b2-bfee-494a-beaa-8db7702d03ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:06.468900 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-383961b2-bfee-494a-beaa-8db7702d03ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:06.482486 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-383961b2-bfee-494a-beaa-8db7702d03ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.174628 Dec 15 19:10:06.483073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 594/1118] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:06 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:10:07.277914 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:07.278680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:07.285483 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:07.286056 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:07.286859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:07.287293 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:07.424313 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:07.427581 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:07.429099 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:07.430276 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-285c40e0-80ca-4c52-a63c-aaf05f4cd554 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.156115 Dec 15 19:10:07.431330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 595/1119] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:07 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:07.499701 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3aa90dd9-6f42-42c1-b2e4-879df96648ff tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:07.500299 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3aa90dd9-6f42-42c1-b2e4-879df96648ff tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:07.506160 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3aa90dd9-6f42-42c1-b2e4-879df96648ff tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:07.506604 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3aa90dd9-6f42-42c1-b2e4-879df96648ff tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:07.507367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3aa90dd9-6f42-42c1-b2e4-879df96648ff tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:07.507887 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3aa90dd9-6f42-42c1-b2e4-879df96648ff tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:07.656129 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3aa90dd9-6f42-42c1-b2e4-879df96648ff tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:07.665322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3aa90dd9-6f42-42c1-b2e4-879df96648ff tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.169225 Dec 15 19:10:07.666426 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 596/1120] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:07 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:10:08.449075 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:08.449777 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:08.456433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:08.456879 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:08.457699 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:08.458127 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:08.591665 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:08.600504 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:08.602026 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:08.603205 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d864e17f-61f2-4297-9f25-a948d97c5d9f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.157949 Dec 15 19:10:08.603750 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 597/1121] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:08 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:10:08.682713 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f80b3ef5-e80c-48bf-ab25-f8c760e0c853 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:08.683339 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f80b3ef5-e80c-48bf-ab25-f8c760e0c853 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:08.690466 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f80b3ef5-e80c-48bf-ab25-f8c760e0c853 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:08.690922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f80b3ef5-e80c-48bf-ab25-f8c760e0c853 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:08.691721 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f80b3ef5-e80c-48bf-ab25-f8c760e0c853 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:08.692157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f80b3ef5-e80c-48bf-ab25-f8c760e0c853 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:08.869140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f80b3ef5-e80c-48bf-ab25-f8c760e0c853 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:08.877305 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f80b3ef5-e80c-48bf-ab25-f8c760e0c853 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.198490 Dec 15 19:10:08.878379 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 598/1122] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:08 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:10:09.611430 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8c1c23fd-e12c-4c12-869b-be2b51387c70 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 33292 microversion: 2.1 time: 10.442117 Dec 15 19:10:09.612724 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 525/1123] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:09:59 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 33292 bytes in 10444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:09.621285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:09.622571 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:09.628167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:09.628611 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:09.629415 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:09.629847 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:09.758925 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:09.766813 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:09.768803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:09.769983 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1fbfb6f5-55fb-47d7-a926-d9c8dbfbe29e tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.152694 Dec 15 19:10:09.770537 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 599/1124] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:09 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:09.895948 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4657fee8-d557-4ae8-b133-8b03b12e283b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:09.896569 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4657fee8-d557-4ae8-b133-8b03b12e283b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:09.903404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4657fee8-d557-4ae8-b133-8b03b12e283b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:09.903850 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4657fee8-d557-4ae8-b133-8b03b12e283b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:09.904622 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4657fee8-d557-4ae8-b133-8b03b12e283b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:09.905057 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4657fee8-d557-4ae8-b133-8b03b12e283b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:10.050270 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4657fee8-d557-4ae8-b133-8b03b12e283b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:10.058276 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4657fee8-d557-4ae8-b133-8b03b12e283b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1758 microversion: 2.1 time: 0.166922 Dec 15 19:10:10.058847 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 526/1125] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:09 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:10:10.624112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7e3256c2-2ebe-42dc-837a-7ac01a721586 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:10.624946 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7e3256c2-2ebe-42dc-837a-7ac01a721586 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:10.631777 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7e3256c2-2ebe-42dc-837a-7ac01a721586 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:10.633959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7e3256c2-2ebe-42dc-837a-7ac01a721586 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:10.633959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7e3256c2-2ebe-42dc-837a-7ac01a721586 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:10.633959 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7e3256c2-2ebe-42dc-837a-7ac01a721586 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:10.714406 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7e3256c2-2ebe-42dc-837a-7ac01a721586 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 33871 microversion: 2.1 time: 0.093963 Dec 15 19:10:10.715034 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 600/1126] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:10 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 33871 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:10.787554 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:10.788158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:10.794444 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:10.794890 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:10.795661 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:10.796097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:10.921795 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:10.930054 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:10.931546 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:10.932695 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-736f71de-5790-4544-8a4e-af0eb0634569 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.148884 Dec 15 19:10:10.933280 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 527/1127] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:10 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:11.076367 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fd4c7e61-3979-4570-b322-f84c59d1557f tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:11.077103 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fd4c7e61-3979-4570-b322-f84c59d1557f tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:11.083882 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e61-3979-4570-b322-f84c59d1557f tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:11.084339 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e61-3979-4570-b322-f84c59d1557f tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:11.085136 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e61-3979-4570-b322-f84c59d1557f tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:11.085573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e61-3979-4570-b322-f84c59d1557f tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:11.224780 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fd4c7e61-3979-4570-b322-f84c59d1557f tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:11.232524 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fd4c7e61-3979-4570-b322-f84c59d1557f tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1761 microversion: 2.1 time: 0.160205 Dec 15 19:10:11.233108 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 601/1128] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:11 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1761 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:10:11.725932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f1ef4e39-03f0-4a70-9a4b-de02d6b93a87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:11.726873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f1ef4e39-03f0-4a70-9a4b-de02d6b93a87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:11.733148 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f1ef4e39-03f0-4a70-9a4b-de02d6b93a87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:11.733600 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f1ef4e39-03f0-4a70-9a4b-de02d6b93a87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:11.734383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f1ef4e39-03f0-4a70-9a4b-de02d6b93a87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:11.734823 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f1ef4e39-03f0-4a70-9a4b-de02d6b93a87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:11.819728 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f1ef4e39-03f0-4a70-9a4b-de02d6b93a87 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 35061 microversion: 2.1 time: 0.097322 Dec 15 19:10:11.820352 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 528/1129] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:11 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 35061 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:11.950667 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:11.951309 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:11.958376 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:11.958883 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:11.959677 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:11.960116 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:12.091455 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:12.099085 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:12.100572 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:12.101733 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2c820160-bc35-49c3-8d60-ab458fc71bf6 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.154876 Dec 15 19:10:12.102285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 602/1130] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:11 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:12.832407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-2057c137-35d6-4e05-820a-0b06f2f0e85d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:12.833448 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-2057c137-35d6-4e05-820a-0b06f2f0e85d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:12.840268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2057c137-35d6-4e05-820a-0b06f2f0e85d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:12.840714 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2057c137-35d6-4e05-820a-0b06f2f0e85d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:12.841511 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2057c137-35d6-4e05-820a-0b06f2f0e85d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:12.841946 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-2057c137-35d6-4e05-820a-0b06f2f0e85d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:12.921107 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-2057c137-35d6-4e05-820a-0b06f2f0e85d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 36100 microversion: 2.1 time: 0.093109 Dec 15 19:10:12.921738 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 529/1131] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:12 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 36100 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:13.120410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:13.120944 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:13.127734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:13.128177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:13.128940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:13.129448 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:13.257579 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:13.265668 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:13.266997 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:13.268842 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a8b3f743-c249-4a0d-a6ea-56a32caf1555 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.151880 Dec 15 19:10:13.269433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 603/1132] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:13 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:13.932427 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1841f9ca-c3bd-42b6-b870-078af901cf9c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:13.933472 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1841f9ca-c3bd-42b6-b870-078af901cf9c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:13.940357 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1841f9ca-c3bd-42b6-b870-078af901cf9c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:13.940803 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1841f9ca-c3bd-42b6-b870-078af901cf9c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:13.941610 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1841f9ca-c3bd-42b6-b870-078af901cf9c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:13.942042 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1841f9ca-c3bd-42b6-b870-078af901cf9c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:14.017303 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1841f9ca-c3bd-42b6-b870-078af901cf9c tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 37558 microversion: 2.1 time: 0.088639 Dec 15 19:10:14.021552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 530/1133] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:13 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 37558 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:14.287559 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:14.288135 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:14.294470 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:14.294920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:14.295696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:14.296131 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:14.426963 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:14.434663 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:14.436157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:14.437330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-84e4ff8a-da26-4b61-8cae-fde360b6b7ec tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.154151 Dec 15 19:10:14.437890 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 604/1134] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:14 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:15.029637 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f89275ac-0750-4842-b6d7-c580693232e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:15.030656 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f89275ac-0750-4842-b6d7-c580693232e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:15.037542 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f89275ac-0750-4842-b6d7-c580693232e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:15.037992 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f89275ac-0750-4842-b6d7-c580693232e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:15.038768 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f89275ac-0750-4842-b6d7-c580693232e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:15.039203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f89275ac-0750-4842-b6d7-c580693232e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:15.129117 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f89275ac-0750-4842-b6d7-c580693232e6 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 38179 microversion: 2.1 time: 0.103268 Dec 15 19:10:15.129783 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 531/1135] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:15 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 38179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:15.455171 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:15.455783 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:15.462155 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:15.462608 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:15.463391 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:15.463827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:15.595424 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:15.603853 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:15.605386 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:15.606548 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c538dd68-99d6-4055-baed-842e498d23ae tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.155090 Dec 15 19:10:15.607113 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 605/1136] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:15 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:15.618601 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-2c09e236-0a5b-4bad-9e0e-4b8eee74c33b req-0f919dbb-8093-40e1-a54f-029f953c16d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8ea341-62ac-42cb-8ae6-b14554543d64", "name": "network-vif-plugged", "status": "completed", "tag": "b365bf51-9207-425f-b345-4f76d1e37689"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:15.620351 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:10:15.620351 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:10:15.628371 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-2c09e236-0a5b-4bad-9e0e-4b8eee74c33b req-0f919dbb-8093-40e1-a54f-029f953c16d3 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:15.628848 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-2c09e236-0a5b-4bad-9e0e-4b8eee74c33b req-0f919dbb-8093-40e1-a54f-029f953c16d3 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:15.639444 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-2c09e236-0a5b-4bad-9e0e-4b8eee74c33b req-0f919dbb-8093-40e1-a54f-029f953c16d3 service nova] Creating event network-vif-plugged:b365bf51-9207-425f-b345-4f76d1e37689 for instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 on hv-cinder-81268 Dec 15 19:10:15.644169 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-2c09e236-0a5b-4bad-9e0e-4b8eee74c33b req-0f919dbb-8093-40e1-a54f-029f953c16d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029851 Dec 15 19:10:15.644748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 532/1137] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:10:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:16.140954 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e0d8776c-f3bf-46bd-ae2c-24e74216b564 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:16.141869 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e0d8776c-f3bf-46bd-ae2c-24e74216b564 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:16.148327 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e0d8776c-f3bf-46bd-ae2c-24e74216b564 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:16.148770 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e0d8776c-f3bf-46bd-ae2c-24e74216b564 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:16.149575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e0d8776c-f3bf-46bd-ae2c-24e74216b564 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:16.150001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e0d8776c-f3bf-46bd-ae2c-24e74216b564 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:16.232299 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e0d8776c-f3bf-46bd-ae2c-24e74216b564 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 38179 microversion: 2.1 time: 0.094840 Dec 15 19:10:16.232846 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 606/1138] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:16 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 38179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:16.628233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:16.628956 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:16.635292 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:16.635748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:16.636535 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:16.636969 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:16.768294 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:16.776932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:16.778552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:16.779712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b166b160-8a04-4408-b466-d2e91cb93aef tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.156713 Dec 15 19:10:16.780316 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 533/1139] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:16 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 19:10:17.244390 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bf651bb2-6feb-4e14-b6f8-d91e7cddb072 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:17.245404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bf651bb2-6feb-4e14-b6f8-d91e7cddb072 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:17.257590 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf651bb2-6feb-4e14-b6f8-d91e7cddb072 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:17.258045 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf651bb2-6feb-4e14-b6f8-d91e7cddb072 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:17.259391 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf651bb2-6feb-4e14-b6f8-d91e7cddb072 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:17.259827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bf651bb2-6feb-4e14-b6f8-d91e7cddb072 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:17.325692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bf651bb2-6feb-4e14-b6f8-d91e7cddb072 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 38179 microversion: 2.1 time: 0.085315 Dec 15 19:10:17.326324 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 607/1140] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:17 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 38179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:17.802827 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:17.803493 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:17.809777 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:17.810223 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:17.811004 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:17.811443 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:17.940958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:17.948717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:17.950249 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:17.951391 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-75ae2274-5279-424d-b4ea-37474bd57e0f tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1730 microversion: 2.20 time: 0.152303 Dec 15 19:10:17.951962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 534/1141] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:17 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:18.338683 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e5a450fe-ae5b-4cd5-a784-d766d9cd4a8d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:18.339662 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e5a450fe-ae5b-4cd5-a784-d766d9cd4a8d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:18.346399 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e5a450fe-ae5b-4cd5-a784-d766d9cd4a8d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:18.346843 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e5a450fe-ae5b-4cd5-a784-d766d9cd4a8d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:18.347638 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e5a450fe-ae5b-4cd5-a784-d766d9cd4a8d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:18.348069 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e5a450fe-ae5b-4cd5-a784-d766d9cd4a8d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:18.429371 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e5a450fe-ae5b-4cd5-a784-d766d9cd4a8d tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 38191 microversion: 2.1 time: 0.094362 Dec 15 19:10:18.430043 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 608/1142] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:18 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 38191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:18.969996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:18.971216 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:18.977666 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:18.978133 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:18.978927 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:18.979375 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:19.112721 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:19.120712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:19.122233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:19.123362 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-bc0d27cd-ab17-4044-bb38-e5f0f4ee4085 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1717 microversion: 2.20 time: 0.157044 Dec 15 19:10:19.123933 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 535/1143] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:18 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:19.441341 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6b6f4d46-8ad6-4ae4-b70b-308d4a440773 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:19.442323 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6b6f4d46-8ad6-4ae4-b70b-308d4a440773 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:19.449057 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d46-8ad6-4ae4-b70b-308d4a440773 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:19.449573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d46-8ad6-4ae4-b70b-308d4a440773 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:19.450337 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d46-8ad6-4ae4-b70b-308d4a440773 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:19.450764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d46-8ad6-4ae4-b70b-308d4a440773 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:19.522517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6b6f4d46-8ad6-4ae4-b70b-308d4a440773 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action" status: 200 len: 38308 microversion: 2.1 time: 0.085526 Dec 15 19:10:19.523059 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 609/1144] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:19 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/action => generated 38308 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 19:10:19.532923 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e3a9358a-fa8f-4c78-88c7-b95c43f250c9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:19.533440 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e3a9358a-fa8f-4c78-88c7-b95c43f250c9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:19.540054 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e3a9358a-fa8f-4c78-88c7-b95c43f250c9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:19.540509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e3a9358a-fa8f-4c78-88c7-b95c43f250c9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:19.541374 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e3a9358a-fa8f-4c78-88c7-b95c43f250c9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:19.541843 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e3a9358a-fa8f-4c78-88c7-b95c43f250c9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:19.565437 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e3a9358a-fa8f-4c78-88c7-b95c43f250c9 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/ips" status: 200 len: 146 microversion: 2.1 time: 0.036097 Dec 15 19:10:19.566009 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 536/1145] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Dec 15 19:10:19 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:21.105404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-988ebfe3-3a1c-447f-a6bb-5f34cb193026 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b2eaccc-56fc-4d9f-95ba-3058a0fe7202"}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:21.106546 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-988ebfe3-3a1c-447f-a6bb-5f34cb193026 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:21.113940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-988ebfe3-3a1c-447f-a6bb-5f34cb193026 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:21.114393 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-988ebfe3-3a1c-447f-a6bb-5f34cb193026 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:21.115174 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-988ebfe3-3a1c-447f-a6bb-5f34cb193026 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:21.115650 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-988ebfe3-3a1c-447f-a6bb-5f34cb193026 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:21.842076 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-988ebfe3-3a1c-447f-a6bb-5f34cb193026 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740647 Dec 15 19:10:21.842703 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 610/1146] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:10:21 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:29.385983 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d095a95c-8b50-4af6-a421-868be18e8888 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:29.386896 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d095a95c-8b50-4af6-a421-868be18e8888 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:29.393156 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d095a95c-8b50-4af6-a421-868be18e8888 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:29.393613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d095a95c-8b50-4af6-a421-868be18e8888 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:29.394390 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d095a95c-8b50-4af6-a421-868be18e8888 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:29.394834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d095a95c-8b50-4af6-a421-868be18e8888 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:29.424991 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d095a95c-8b50-4af6-a421-868be18e8888 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042689 Dec 15 19:10:29.425637 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 537/1147] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:10:29 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:29.436075 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-441a9550-8b18-4427-9466-3a34555e8ce3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:29.436688 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-441a9550-8b18-4427-9466-3a34555e8ce3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:29.445920 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-441a9550-8b18-4427-9466-3a34555e8ce3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:29.446373 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-441a9550-8b18-4427-9466-3a34555e8ce3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:29.447157 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-441a9550-8b18-4427-9466-3a34555e8ce3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:29.447595 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-441a9550-8b18-4427-9466-3a34555e8ce3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:29.475925 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-441a9550-8b18-4427-9466-3a34555e8ce3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/4b2eaccc-56fc-4d9f-95ba-3058a0fe7202" status: 200 len: 194 microversion: 2.1 time: 0.044418 Dec 15 19:10:29.476528 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 611/1148] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Dec 15 19:10:29 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/4b2eaccc-56fc-4d9f-95ba-3058a0fe7202 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:30.992851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-edf146b9-8af1-44cc-9f2a-2c477dea7a3a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1c93032-24fb-41ea-9023-dbb4a4030f26"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:30.993932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-edf146b9-8af1-44cc-9f2a-2c477dea7a3a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:31.000194 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-edf146b9-8af1-44cc-9f2a-2c477dea7a3a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:31.000652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-edf146b9-8af1-44cc-9f2a-2c477dea7a3a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:31.001482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-edf146b9-8af1-44cc-9f2a-2c477dea7a3a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:31.001910 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-edf146b9-8af1-44cc-9f2a-2c477dea7a3a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:31.618774 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-edf146b9-8af1-44cc-9f2a-2c477dea7a3a tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629795 Dec 15 19:10:31.619378 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 538/1149] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Dec 15 19:10:30 2021] POST /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:39.084004 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ff2ab40a-2858-45ec-8a1f-42bb48ab8d67 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:39.085280 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ff2ab40a-2858-45ec-8a1f-42bb48ab8d67 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:39.091610 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff2ab40a-2858-45ec-8a1f-42bb48ab8d67 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:39.096316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff2ab40a-2858-45ec-8a1f-42bb48ab8d67 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:39.096316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff2ab40a-2858-45ec-8a1f-42bb48ab8d67 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:39.096316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff2ab40a-2858-45ec-8a1f-42bb48ab8d67 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:39.124010 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ff2ab40a-2858-45ec-8a1f-42bb48ab8d67 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044214 Dec 15 19:10:39.124489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 612/1150] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:10:39 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:39.372855 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d6d33bfc-7126-4fde-b1d5-96d7d4b39206 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:39.373477 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d6d33bfc-7126-4fde-b1d5-96d7d4b39206 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:39.380142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d6d33bfc-7126-4fde-b1d5-96d7d4b39206 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:39.380531 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d6d33bfc-7126-4fde-b1d5-96d7d4b39206 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:39.381346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d6d33bfc-7126-4fde-b1d5-96d7d4b39206 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:39.381787 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d6d33bfc-7126-4fde-b1d5-96d7d4b39206 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:39.409725 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d6d33bfc-7126-4fde-b1d5-96d7d4b39206 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/4b2eaccc-56fc-4d9f-95ba-3058a0fe7202" status: 200 len: 194 microversion: 2.1 time: 0.041550 Dec 15 19:10:39.410298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 539/1151] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Dec 15 19:10:39 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/4b2eaccc-56fc-4d9f-95ba-3058a0fe7202 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:39.419563 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9fd9a636-2a48-4502-82ea-3f13babcf208 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:39.420047 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9fd9a636-2a48-4502-82ea-3f13babcf208 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:39.425898 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fd9a636-2a48-4502-82ea-3f13babcf208 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:39.426340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fd9a636-2a48-4502-82ea-3f13babcf208 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:39.427100 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fd9a636-2a48-4502-82ea-3f13babcf208 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:39.427526 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9fd9a636-2a48-4502-82ea-3f13babcf208 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:39.503850 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-9fd9a636-2a48-4502-82ea-3f13babcf208 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lazy-loading 'services' on Instance uuid 633f7767-df32-4ca3-986c-07c1c0a517b7 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:10:39.727491 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9fd9a636-2a48-4502-82ea-3f13babcf208 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "DELETE /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/4b2eaccc-56fc-4d9f-95ba-3058a0fe7202" status: 202 len: 0 microversion: 2.1 time: 0.311505 Dec 15 19:10:39.728079 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 613/1152] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:10:39 2021] DELETE /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/4b2eaccc-56fc-4d9f-95ba-3058a0fe7202 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:10:41.880427 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fafab34d-7730-4024-ab95-328ac60e4c8b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:41.880923 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fafab34d-7730-4024-ab95-328ac60e4c8b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:41.887069 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fafab34d-7730-4024-ab95-328ac60e4c8b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:41.887522 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fafab34d-7730-4024-ab95-328ac60e4c8b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:41.888328 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fafab34d-7730-4024-ab95-328ac60e4c8b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:41.888749 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fafab34d-7730-4024-ab95-328ac60e4c8b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:41.916713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fafab34d-7730-4024-ab95-328ac60e4c8b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/a1c93032-24fb-41ea-9023-dbb4a4030f26" status: 200 len: 194 microversion: 2.1 time: 0.040008 Dec 15 19:10:41.917321 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 540/1153] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Dec 15 19:10:41 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/a1c93032-24fb-41ea-9023-dbb4a4030f26 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:41.928504 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a3055d3e-b7fc-421e-96e5-5cb763e9762b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:41.929092 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a3055d3e-b7fc-421e-96e5-5cb763e9762b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:41.935111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3055d3e-b7fc-421e-96e5-5cb763e9762b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:41.939984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3055d3e-b7fc-421e-96e5-5cb763e9762b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:41.939984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3055d3e-b7fc-421e-96e5-5cb763e9762b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:41.939984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a3055d3e-b7fc-421e-96e5-5cb763e9762b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:42.011799 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-a3055d3e-b7fc-421e-96e5-5cb763e9762b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lazy-loading 'services' on Instance uuid 633f7767-df32-4ca3-986c-07c1c0a517b7 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:10:42.183831 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a3055d3e-b7fc-421e-96e5-5cb763e9762b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "DELETE /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/a1c93032-24fb-41ea-9023-dbb4a4030f26" status: 202 len: 0 microversion: 2.1 time: 0.260330 Dec 15 19:10:42.184419 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 614/1154] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:10:41 2021] DELETE /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments/a1c93032-24fb-41ea-9023-dbb4a4030f26 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:10:43.334038 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d4294cf4-2e9e-495f-8e23-dc98a071cad8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:43.335007 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d4294cf4-2e9e-495f-8e23-dc98a071cad8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:43.341645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4294cf4-2e9e-495f-8e23-dc98a071cad8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:43.342090 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4294cf4-2e9e-495f-8e23-dc98a071cad8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:43.342871 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4294cf4-2e9e-495f-8e23-dc98a071cad8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:43.343301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d4294cf4-2e9e-495f-8e23-dc98a071cad8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:43.372612 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d4294cf4-2e9e-495f-8e23-dc98a071cad8 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042253 Dec 15 19:10:43.373183 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 541/1155] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:10:43 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:10:43.471817 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f0c62006-2952-43ac-83f2-bc8619e93621 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:43.472796 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f0c62006-2952-43ac-83f2-bc8619e93621 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:43.478798 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f0c62006-2952-43ac-83f2-bc8619e93621 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:43.479245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f0c62006-2952-43ac-83f2-bc8619e93621 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:43.480021 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f0c62006-2952-43ac-83f2-bc8619e93621 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:43.480454 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f0c62006-2952-43ac-83f2-bc8619e93621 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:43.508090 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f0c62006-2952-43ac-83f2-bc8619e93621 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041477 Dec 15 19:10:43.508627 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 615/1156] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:10:43 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:10:43.568087 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a9c9f399-0645-40dd-a5db-34bb9e6d531b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:43.568593 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a9c9f399-0645-40dd-a5db-34bb9e6d531b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:43.574331 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9c9f399-0645-40dd-a5db-34bb9e6d531b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:43.574784 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9c9f399-0645-40dd-a5db-34bb9e6d531b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:43.575559 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9c9f399-0645-40dd-a5db-34bb9e6d531b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:43.576027 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a9c9f399-0645-40dd-a5db-34bb9e6d531b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:43.600547 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a9c9f399-0645-40dd-a5db-34bb9e6d531b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:10:43.927694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a9c9f399-0645-40dd-a5db-34bb9e6d531b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "DELETE /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 204 len: 0 microversion: 2.1 time: 0.362906 Dec 15 19:10:43.928292 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 542/1157] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:10:43 2021] DELETE /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:10:43.936075 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-326f3432-2cef-4e61-8c9b-cf389f69db36 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:43.936682 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-326f3432-2cef-4e61-8c9b-cf389f69db36 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:43.943217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-326f3432-2cef-4e61-8c9b-cf389f69db36 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:43.943669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-326f3432-2cef-4e61-8c9b-cf389f69db36 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:43.944446 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-326f3432-2cef-4e61-8c9b-cf389f69db36 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:43.944879 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-326f3432-2cef-4e61-8c9b-cf389f69db36 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:44.071654 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-326f3432-2cef-4e61-8c9b-cf389f69db36 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:44.078980 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-326f3432-2cef-4e61-8c9b-cf389f69db36 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1674 microversion: 2.1 time: 0.146482 Dec 15 19:10:44.080335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 616/1158] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:43 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:45.098602 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ad3cb934-d9f2-4a02-8ee8-1a31ddb8ff73 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:45.099307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ad3cb934-d9f2-4a02-8ee8-1a31ddb8ff73 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:45.105650 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ad3cb934-d9f2-4a02-8ee8-1a31ddb8ff73 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:45.106109 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ad3cb934-d9f2-4a02-8ee8-1a31ddb8ff73 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:45.106899 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ad3cb934-d9f2-4a02-8ee8-1a31ddb8ff73 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:45.107338 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ad3cb934-d9f2-4a02-8ee8-1a31ddb8ff73 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:45.233786 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ad3cb934-d9f2-4a02-8ee8-1a31ddb8ff73 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:45.241347 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ad3cb934-d9f2-4a02-8ee8-1a31ddb8ff73 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1674 microversion: 2.1 time: 0.147392 Dec 15 19:10:45.241916 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 543/1159] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:45 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:46.257899 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-703a0217-1d7b-47c5-bc59-494a9f0448d3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:46.258493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-703a0217-1d7b-47c5-bc59-494a9f0448d3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:46.265643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-703a0217-1d7b-47c5-bc59-494a9f0448d3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:46.265643 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-703a0217-1d7b-47c5-bc59-494a9f0448d3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:46.266320 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-703a0217-1d7b-47c5-bc59-494a9f0448d3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:46.266792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-703a0217-1d7b-47c5-bc59-494a9f0448d3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:46.514966 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-703a0217-1d7b-47c5-bc59-494a9f0448d3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:46.523661 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-703a0217-1d7b-47c5-bc59-494a9f0448d3 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1674 microversion: 2.1 time: 0.269279 Dec 15 19:10:46.524443 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 617/1160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:46 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1674 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:46.943284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-9794b090-3530-47b0-9267-b30c071914a4 req-64b85348-9f10-44ba-a13f-6e625dcf1465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633f7767-df32-4ca3-986c-07c1c0a517b7", "name": "network-vif-deleted", "tag": "76e0bcfc-5319-45ee-ba0d-5566b3fc3537"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:46.944808 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:10:46.944808 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:10:46.952168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-9794b090-3530-47b0-9267-b30c071914a4 req-64b85348-9f10-44ba-a13f-6e625dcf1465 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:46.959102 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-9794b090-3530-47b0-9267-b30c071914a4 req-64b85348-9f10-44ba-a13f-6e625dcf1465 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:46.965615 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-9794b090-3530-47b0-9267-b30c071914a4 req-64b85348-9f10-44ba-a13f-6e625dcf1465 service nova] Creating event network-vif-deleted:76e0bcfc-5319-45ee-ba0d-5566b3fc3537 for instance 633f7767-df32-4ca3-986c-07c1c0a517b7 on hv-cinder-81268 Dec 15 19:10:46.971933 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-9794b090-3530-47b0-9267-b30c071914a4 req-64b85348-9f10-44ba-a13f-6e625dcf1465 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Dec 15 19:10:46.972655 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 544/1161] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:10:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:47.541245 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:47.541837 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:47.548640 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:47.549120 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:47.549901 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:47.550332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:47.581397 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:47.581842 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:47.582285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lazy-loading 'fault' on Instance uuid 633f7767-df32-4ca3-986c-07c1c0a517b7 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:10:47.624116 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23109dba24548acb418028b9578f1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10e0bf29ca2c44d5ba3c4306a437e9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:47.631462 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ff46872a-1cbf-4a55-9217-714c43ff5708 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 200 len: 1327 microversion: 2.1 time: 0.093927 Dec 15 19:10:47.632039 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 618/1162] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:47 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:48.649764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7ec23071-ba33-44b1-8ad8-4c6628731d7b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:48.650502 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7ec23071-ba33-44b1-8ad8-4c6628731d7b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:48.656585 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7ec23071-ba33-44b1-8ad8-4c6628731d7b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:48.657067 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7ec23071-ba33-44b1-8ad8-4c6628731d7b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:48.657925 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7ec23071-ba33-44b1-8ad8-4c6628731d7b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:48.659040 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7ec23071-ba33-44b1-8ad8-4c6628731d7b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:48.671122 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-7ec23071-ba33-44b1-8ad8-4c6628731d7b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] HTTP exception thrown: Instance 633f7767-df32-4ca3-986c-07c1c0a517b7 could not be found. Dec 15 19:10:48.671706 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7ec23071-ba33-44b1-8ad8-4c6628731d7b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Returning 404 to user: Instance 633f7767-df32-4ca3-986c-07c1c0a517b7 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:48.672516 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7ec23071-ba33-44b1-8ad8-4c6628731d7b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 404 len: 111 microversion: 2.1 time: 0.027358 Dec 15 19:10:48.673044 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 545/1163] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:48 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:10:48.681187 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d723e417-2fbb-4298-b654-4e0cdaa419df tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '.version_select at 0x7f80b628bdc0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:48.760468 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d723e417-2fbb-4298-b654-4e0cdaa419df tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434598661" status: 202 len: 0 microversion: 2.1 time: 0.082806 Dec 15 19:10:48.761055 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 619/1164] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Dec 15 19:10:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434598661 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:10:49.820834 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fed43d04-31c7-4f89-b10a-0f7a80a724a6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1745562836"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:49.821404 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fed43d04-31c7-4f89-b10a-0f7a80a724a6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:49.827563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fed43d04-31c7-4f89-b10a-0f7a80a724a6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:49.828008 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fed43d04-31c7-4f89-b10a-0f7a80a724a6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:49.828806 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fed43d04-31c7-4f89-b10a-0f7a80a724a6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:49.829758 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fed43d04-31c7-4f89-b10a-0f7a80a724a6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:49.958990 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.network.security_group_api [None req-fed43d04-31c7-4f89-b10a-0f7a80a724a6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Removing security group 3f4d5545-fc2d-40a8-a4db-c0e483a62f37 from port b5f44d8c-08ee-4a4e-85f0-5c1829876e7e Dec 15 19:10:50.354026 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fed43d04-31c7-4f89-b10a-0f7a80a724a6 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "POST /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/action" status: 202 len: 0 microversion: 2.1 time: 0.536976 Dec 15 19:10:50.355245 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 546/1165] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:10:49 2021] POST /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:10:50.366609 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-94fc6006-fc44-4c4d-933c-03bacfb73396 req-d5a45f7a-fcdb-4ca1-ad8e-805f9eb7960a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0c4ba6-607a-4213-adfc-22306c7c61bd", "tag": "b5f44d8c-08ee-4a4e-85f0-5c1829876e7e"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:50.368764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:10:50.368764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:10:50.380252 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-94fc6006-fc44-4c4d-933c-03bacfb73396 req-d5a45f7a-fcdb-4ca1-ad8e-805f9eb7960a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:50.386972 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-94fc6006-fc44-4c4d-933c-03bacfb73396 req-d5a45f7a-fcdb-4ca1-ad8e-805f9eb7960a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:50.392489 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-94fc6006-fc44-4c4d-933c-03bacfb73396 req-d5a45f7a-fcdb-4ca1-ad8e-805f9eb7960a service nova] Creating event network-changed:b5f44d8c-08ee-4a4e-85f0-5c1829876e7e for instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd on hv-cinder-81268 Dec 15 19:10:50.398688 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-94fc6006-fc44-4c4d-933c-03bacfb73396 req-d5a45f7a-fcdb-4ca1-ad8e-805f9eb7960a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036442 Dec 15 19:10:50.399609 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 620/1166] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:10:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:51.704849 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ad5cfb81-b1ff-45a0-8b93-e8a4496ded16 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:51.705475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ad5cfb81-b1ff-45a0-8b93-e8a4496ded16 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:51.711505 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ad5cfb81-b1ff-45a0-8b93-e8a4496ded16 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:51.712035 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ad5cfb81-b1ff-45a0-8b93-e8a4496ded16 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:51.712907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ad5cfb81-b1ff-45a0-8b93-e8a4496ded16 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:51.713448 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ad5cfb81-b1ff-45a0-8b93-e8a4496ded16 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:51.790041 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-ad5cfb81-b1ff-45a0-8b93-e8a4496ded16 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lazy-loading 'services' on Instance uuid 3b0c4ba6-607a-4213-adfc-22306c7c61bd {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:10:51.996045 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ad5cfb81-b1ff-45a0-8b93-e8a4496ded16 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments/d6cd72f0-87f7-49d2-aacd-9c91649c3008" status: 202 len: 0 microversion: 2.1 time: 0.295874 Dec 15 19:10:51.999996 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 547/1167] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:10:51 2021] DELETE /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments/d6cd72f0-87f7-49d2-aacd-9c91649c3008 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:10:52.006160 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5f28251e-fffa-4ad6-b5dd-c53241c44523 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:52.006406 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4c728c15-9518-491d-ab57-9bee9a168670 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:52.007404 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4c728c15-9518-491d-ab57-9bee9a168670 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:52.008099 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5f28251e-fffa-4ad6-b5dd-c53241c44523 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:52.014707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f28251e-fffa-4ad6-b5dd-c53241c44523 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.018023 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f28251e-fffa-4ad6-b5dd-c53241c44523 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.018023 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f28251e-fffa-4ad6-b5dd-c53241c44523 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.018023 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5f28251e-fffa-4ad6-b5dd-c53241c44523 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.019882 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4c728c15-9518-491d-ab57-9bee9a168670 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.020514 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4c728c15-9518-491d-ab57-9bee9a168670 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.023344 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4c728c15-9518-491d-ab57-9bee9a168670 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.023878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4c728c15-9518-491d-ab57-9bee9a168670 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.053647 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5f28251e-fffa-4ad6-b5dd-c53241c44523 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051575 Dec 15 19:10:52.058641 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 548/1168] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:10:52 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:52.064137 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9e3bc6ab-a90d-4dd0-83a6-0abf436ebdcc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:52.064571 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9e3bc6ab-a90d-4dd0-83a6-0abf436ebdcc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:52.065814 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4c728c15-9518-491d-ab57-9bee9a168670 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064920 Dec 15 19:10:52.066394 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 621/1169] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Dec 15 19:10:51 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:52.073359 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9e3bc6ab-a90d-4dd0-83a6-0abf436ebdcc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.074071 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9e3bc6ab-a90d-4dd0-83a6-0abf436ebdcc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.075363 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9e3bc6ab-a90d-4dd0-83a6-0abf436ebdcc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.076055 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9e3bc6ab-a90d-4dd0-83a6-0abf436ebdcc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.093445 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-9e3bc6ab-a90d-4dd0-83a6-0abf436ebdcc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] HTTP exception thrown: Instance 633f7767-df32-4ca3-986c-07c1c0a517b7 could not be found. Dec 15 19:10:52.094053 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9e3bc6ab-a90d-4dd0-83a6-0abf436ebdcc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Returning 404 to user: Instance 633f7767-df32-4ca3-986c-07c1c0a517b7 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:52.095430 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9e3bc6ab-a90d-4dd0-83a6-0abf436ebdcc tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "DELETE /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 404 len: 111 microversion: 2.1 time: 0.035493 Dec 15 19:10:52.098828 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 549/1170] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:10:52 2021] DELETE /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:10:52.105781 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-87057f1d-5fa2-436a-9915-921203966535 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:52.106949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-87057f1d-5fa2-436a-9915-921203966535 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 633f7767-df32-4ca3-986c-07c1c0a517b7] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:52.114151 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87057f1d-5fa2-436a-9915-921203966535 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.115104 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87057f1d-5fa2-436a-9915-921203966535 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.116302 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87057f1d-5fa2-436a-9915-921203966535 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.116921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-87057f1d-5fa2-436a-9915-921203966535 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.135380 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-87057f1d-5fa2-436a-9915-921203966535 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] HTTP exception thrown: Instance 633f7767-df32-4ca3-986c-07c1c0a517b7 could not be found. Dec 15 19:10:52.136968 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-87057f1d-5fa2-436a-9915-921203966535 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Returning 404 to user: Instance 633f7767-df32-4ca3-986c-07c1c0a517b7 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:52.138115 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-87057f1d-5fa2-436a-9915-921203966535 tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7" status: 404 len: 111 microversion: 2.1 time: 0.037871 Dec 15 19:10:52.138678 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 622/1171] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:52 2021] GET /compute/v2.1/servers/633f7767-df32-4ca3-986c-07c1c0a517b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:10:52.139791 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-61723466-26ab-4224-8c0d-3b3ef5b577fb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:52.140298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-61723466-26ab-4224-8c0d-3b3ef5b577fb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:52.149407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-61723466-26ab-4224-8c0d-3b3ef5b577fb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.150354 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-61723466-26ab-4224-8c0d-3b3ef5b577fb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.151246 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-61723466-26ab-4224-8c0d-3b3ef5b577fb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.153353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-61723466-26ab-4224-8c0d-3b3ef5b577fb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.187321 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-61723466-26ab-4224-8c0d-3b3ef5b577fb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:10:52.415254 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-b88bf0c7-210d-4499-8fca-32817ea46db2 req-09a7fa13-0104-44b6-afc6-a7f796a4abd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0c4ba6-607a-4213-adfc-22306c7c61bd", "tag": "b5f44d8c-08ee-4a4e-85f0-5c1829876e7e"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:52.416764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:10:52.416764 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:10:52.424400 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-b88bf0c7-210d-4499-8fca-32817ea46db2 req-09a7fa13-0104-44b6-afc6-a7f796a4abd9 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.425075 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-b88bf0c7-210d-4499-8fca-32817ea46db2 req-09a7fa13-0104-44b6-afc6-a7f796a4abd9 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.436397 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-b88bf0c7-210d-4499-8fca-32817ea46db2 req-09a7fa13-0104-44b6-afc6-a7f796a4abd9 service nova] Creating event network-changed:b5f44d8c-08ee-4a4e-85f0-5c1829876e7e for instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd on hv-cinder-81268 Dec 15 19:10:52.441289 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-b88bf0c7-210d-4499-8fca-32817ea46db2 req-09a7fa13-0104-44b6-afc6-a7f796a4abd9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029653 Dec 15 19:10:52.442074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 623/1172] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:10:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:10:52.473481 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-61723466-26ab-4224-8c0d-3b3ef5b577fb tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 204 len: 0 microversion: 2.20 time: 0.337510 Dec 15 19:10:52.474083 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 550/1173] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Dec 15 19:10:52 2021] DELETE /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 19:10:52.482918 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:52.483621 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:52.490268 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.490723 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.491510 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:52.491947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:52.700128 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:52.709505 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:52.711432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:52.712931 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-22edad65-c422-42fe-beab-927326c19b33 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.234150 Dec 15 19:10:52.718452 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 624/1174] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:52 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:53.067182 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e54326bd-0fcf-406e-9d3c-e22cac4fb7ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:53.068241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e54326bd-0fcf-406e-9d3c-e22cac4fb7ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:53.074771 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e54326bd-0fcf-406e-9d3c-e22cac4fb7ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.075223 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e54326bd-0fcf-406e-9d3c-e22cac4fb7ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.076001 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e54326bd-0fcf-406e-9d3c-e22cac4fb7ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.076439 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e54326bd-0fcf-406e-9d3c-e22cac4fb7ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.105514 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e54326bd-0fcf-406e-9d3c-e22cac4fb7ae tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042933 Dec 15 19:10:53.106235 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 551/1175] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Dec 15 19:10:53 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 19:10:53.115894 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b166f3f3-f629-4bde-946b-f017f59482f2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:53.119586 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b166f3f3-f629-4bde-946b-f017f59482f2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:53.122664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b166f3f3-f629-4bde-946b-f017f59482f2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.123112 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b166f3f3-f629-4bde-946b-f017f59482f2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.123879 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b166f3f3-f629-4bde-946b-f017f59482f2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.124308 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b166f3f3-f629-4bde-946b-f017f59482f2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.196468 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-b166f3f3-f629-4bde-946b-f017f59482f2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] HTTP exception thrown: Instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd is not attached to volume d6cd72f0-87f7-49d2-aacd-9c91649c3008 Dec 15 19:10:53.197125 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b166f3f3-f629-4bde-946b-f017f59482f2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Returning 404 to user: Instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd is not attached to volume d6cd72f0-87f7-49d2-aacd-9c91649c3008 {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:53.200224 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b166f3f3-f629-4bde-946b-f017f59482f2 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments/d6cd72f0-87f7-49d2-aacd-9c91649c3008" status: 404 len: 154 microversion: 2.1 time: 0.086187 Dec 15 19:10:53.200224 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 625/1176] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Dec 15 19:10:53 2021] DELETE /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd/os-volume_attachments/d6cd72f0-87f7-49d2-aacd-9c91649c3008 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 19:10:53.416804 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-02eb690c-2959-4bb4-ba03-2412e0c07e2b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:53.417339 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-02eb690c-2959-4bb4-ba03-2412e0c07e2b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:53.423665 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-02eb690c-2959-4bb4-ba03-2412e0c07e2b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.424116 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-02eb690c-2959-4bb4-ba03-2412e0c07e2b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.424890 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-02eb690c-2959-4bb4-ba03-2412e0c07e2b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.425377 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-02eb690c-2959-4bb4-ba03-2412e0c07e2b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.438929 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-02eb690c-2959-4bb4-ba03-2412e0c07e2b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] HTTP exception thrown: Instance 92d9554d-bb60-4d4e-9ab8-311caafb659f could not be found. Dec 15 19:10:53.439554 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-02eb690c-2959-4bb4-ba03-2412e0c07e2b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Returning 404 to user: Instance 92d9554d-bb60-4d4e-9ab8-311caafb659f could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:53.440353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-02eb690c-2959-4bb4-ba03-2412e0c07e2b tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 404 len: 111 microversion: 2.1 time: 0.027207 Dec 15 19:10:53.440869 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 552/1177] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:10:53 2021] DELETE /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:10:53.448449 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-83e51de5-8743-4044-a9c8-84721a71a60f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:53.449180 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-83e51de5-8743-4044-a9c8-84721a71a60f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] [instance: 92d9554d-bb60-4d4e-9ab8-311caafb659f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:53.455074 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-83e51de5-8743-4044-a9c8-84721a71a60f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.455594 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-83e51de5-8743-4044-a9c8-84721a71a60f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.456378 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-83e51de5-8743-4044-a9c8-84721a71a60f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.456843 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-83e51de5-8743-4044-a9c8-84721a71a60f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.470006 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-83e51de5-8743-4044-a9c8-84721a71a60f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] HTTP exception thrown: Instance 92d9554d-bb60-4d4e-9ab8-311caafb659f could not be found. Dec 15 19:10:53.470578 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-83e51de5-8743-4044-a9c8-84721a71a60f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] Returning 404 to user: Instance 92d9554d-bb60-4d4e-9ab8-311caafb659f could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:53.471433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-83e51de5-8743-4044-a9c8-84721a71a60f tempest-AttachVolumeTestJSON-1360285260 tempest-AttachVolumeTestJSON-1360285260-project] 10.222.0.49 "GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f" status: 404 len: 111 microversion: 2.1 time: 0.026681 Dec 15 19:10:53.471947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 626/1178] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:53 2021] GET /compute/v2.1/servers/92d9554d-bb60-4d4e-9ab8-311caafb659f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 19:10:53.731915 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:53.732442 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:53.739268 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.740066 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.740863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:53.741331 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:53.933921 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:53.942474 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:53.944000 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:53.945172 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-cd9754da-65ea-4498-9af4-3b7d096a8aad tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1723 microversion: 2.20 time: 0.217220 Dec 15 19:10:53.945723 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 553/1179] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:53 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:54.431935 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-2c22e70e-d7e3-4636-a2ec-ed1c9b2b7646 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:54.432686 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2c22e70e-d7e3-4636-a2ec-ed1c9b2b7646 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:54.442021 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2c22e70e-d7e3-4636-a2ec-ed1c9b2b7646 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:54.442587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2c22e70e-d7e3-4636-a2ec-ed1c9b2b7646 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:54.443593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2c22e70e-d7e3-4636-a2ec-ed1c9b2b7646 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:54.444129 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-2c22e70e-d7e3-4636-a2ec-ed1c9b2b7646 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:54.470255 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-2c22e70e-d7e3-4636-a2ec-ed1c9b2b7646 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:10:54.747530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-2c22e70e-d7e3-4636-a2ec-ed1c9b2b7646 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 204 len: 0 microversion: 2.1 time: 0.319039 Dec 15 19:10:54.748581 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 627/1180] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:10:54 2021] DELETE /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:10:54.757383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7a6ab90f-b239-446e-9354-e3fd334930a7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:54.758001 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7a6ab90f-b239-446e-9354-e3fd334930a7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:54.764204 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7a6ab90f-b239-446e-9354-e3fd334930a7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:54.764648 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7a6ab90f-b239-446e-9354-e3fd334930a7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:54.765662 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7a6ab90f-b239-446e-9354-e3fd334930a7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:54.766298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7a6ab90f-b239-446e-9354-e3fd334930a7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:54.957891 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-775f5178-e55c-4cc1-9564-f0475d73d8eb req-d4ecac53-950f-470f-bf3b-995800c24302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8ea341-62ac-42cb-8ae6-b14554543d64", "name": "network-vif-deleted", "tag": "b365bf51-9207-425f-b345-4f76d1e37689"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:54.960587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:10:54.960587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:10:54.968360 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-775f5178-e55c-4cc1-9564-f0475d73d8eb req-d4ecac53-950f-470f-bf3b-995800c24302 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:54.968919 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-775f5178-e55c-4cc1-9564-f0475d73d8eb req-d4ecac53-950f-470f-bf3b-995800c24302 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:54.990162 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-775f5178-e55c-4cc1-9564-f0475d73d8eb req-d4ecac53-950f-470f-bf3b-995800c24302 service nova] Creating event network-vif-deleted:b365bf51-9207-425f-b345-4f76d1e37689 for instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 on hv-cinder-81268 Dec 15 19:10:54.996616 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-775f5178-e55c-4cc1-9564-f0475d73d8eb req-d4ecac53-950f-470f-bf3b-995800c24302 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042934 Dec 15 19:10:54.997584 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 628/1181] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:10:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 19:10:55.004935 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:55.005958 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:55.014937 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7a6ab90f-b239-446e-9354-e3fd334930a7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:55.030715 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7a6ab90f-b239-446e-9354-e3fd334930a7 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1555 microversion: 2.1 time: 0.273411 Dec 15 19:10:55.039018 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:55.040332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:55.041638 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:55.042306 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:55.052230 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 554/1182] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:54 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1555 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:55.162683 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:55.171101 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:55.176685 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '497f05dbb53e48a38abf9529018d1766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8cea93eb6c4a0d90f0c234dbef38f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:55.179474 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a5a05230-0d07-4f05-9c91-3a0d6f47fc4d tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 200 len: 1655 microversion: 2.20 time: 0.180414 Dec 15 19:10:55.184649 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 629/1183] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:54 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 1655 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 19:10:56.052702 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-d3424798-a3ab-4166-88bc-f93478f8dcf8 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:56.053725 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-d3424798-a3ab-4166-88bc-f93478f8dcf8 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:56.061384 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3424798-a3ab-4166-88bc-f93478f8dcf8 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:56.062158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3424798-a3ab-4166-88bc-f93478f8dcf8 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:56.063926 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3424798-a3ab-4166-88bc-f93478f8dcf8 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:56.064581 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-d3424798-a3ab-4166-88bc-f93478f8dcf8 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:56.204741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1d9b6375-a9ef-4782-bb9f-db88493006dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:56.204741 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-1d9b6375-a9ef-4782-bb9f-db88493006dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:56.216040 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1d9b6375-a9ef-4782-bb9f-db88493006dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:56.216599 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1d9b6375-a9ef-4782-bb9f-db88493006dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:56.217601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1d9b6375-a9ef-4782-bb9f-db88493006dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:56.218147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-1d9b6375-a9ef-4782-bb9f-db88493006dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:56.237500 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-1d9b6375-a9ef-4782-bb9f-db88493006dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] HTTP exception thrown: Instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 could not be found. Dec 15 19:10:56.238348 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1d9b6375-a9ef-4782-bb9f-db88493006dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Returning 404 to user: Instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:56.239428 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1d9b6375-a9ef-4782-bb9f-db88493006dd tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 404 len: 111 microversion: 2.20 time: 0.040371 Dec 15 19:10:56.240956 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 630/1184] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:56 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 19:10:56.251593 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f2f0f516-4b37-4093-8157-ce160d5414b1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '.version_select at 0x7f80b628b4c0>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:56.295783 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-d3424798-a3ab-4166-88bc-f93478f8dcf8 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:56.304969 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-d3424798-a3ab-4166-88bc-f93478f8dcf8 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1555 microversion: 2.1 time: 0.256406 Dec 15 19:10:56.305828 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 555/1185] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:56 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:10:56.334192 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f2f0f516-4b37-4093-8157-ce160d5414b1 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238901625" status: 204 len: 0 microversion: 2.20 time: 0.089130 Dec 15 19:10:56.334781 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 631/1186] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Dec 15 19:10:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238901625 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 15 19:10:57.034949 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-cd44fce7-a9d6-4c28-becf-9c9388bbea7e req-161f5c2f-a11e-4e64-ae41-822da937475c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0c4ba6-607a-4213-adfc-22306c7c61bd", "name": "network-vif-deleted", "tag": "b5f44d8c-08ee-4a4e-85f0-5c1829876e7e"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:10:57.036509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:10:57.036509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:10:57.045801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-cd44fce7-a9d6-4c28-becf-9c9388bbea7e req-161f5c2f-a11e-4e64-ae41-822da937475c service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:57.046429 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-cd44fce7-a9d6-4c28-becf-9c9388bbea7e req-161f5c2f-a11e-4e64-ae41-822da937475c service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:57.060899 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-cd44fce7-a9d6-4c28-becf-9c9388bbea7e req-161f5c2f-a11e-4e64-ae41-822da937475c service nova] Creating event network-vif-deleted:b5f44d8c-08ee-4a4e-85f0-5c1829876e7e for instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd on hv-cinder-81268 Dec 15 19:10:57.066952 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-cd44fce7-a9d6-4c28-becf-9c9388bbea7e req-161f5c2f-a11e-4e64-ae41-822da937475c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036049 Dec 15 19:10:57.068217 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 556/1187] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:10:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:10:57.322924 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:57.323592 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:57.331989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:57.332433 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:57.336737 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:57.337393 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:57.392917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:57.392917 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:57.393167 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lazy-loading 'fault' on Instance uuid 3b0c4ba6-607a-4213-adfc-22306c7c61bd {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:10:57.441712 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473179fd6af84654a68376d17726b662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df652172dff4ee08b4dddf7a40b0142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:10:57.450335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-227e5064-1e7b-42aa-8853-d01cc6b5aa5d tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 200 len: 1349 microversion: 2.1 time: 0.130244 Dec 15 19:10:57.451154 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 632/1188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:57 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 1349 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:10:58.468179 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-855d28d8-9684-416e-ae0b-4ca237b104f1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:58.470574 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-855d28d8-9684-416e-ae0b-4ca237b104f1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] [instance: 3b0c4ba6-607a-4213-adfc-22306c7c61bd] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:58.477421 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-855d28d8-9684-416e-ae0b-4ca237b104f1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:58.477929 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-855d28d8-9684-416e-ae0b-4ca237b104f1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:58.478776 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-855d28d8-9684-416e-ae0b-4ca237b104f1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:58.479206 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-855d28d8-9684-416e-ae0b-4ca237b104f1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:58.492746 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-855d28d8-9684-416e-ae0b-4ca237b104f1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] HTTP exception thrown: Instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd could not be found. Dec 15 19:10:58.493386 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-855d28d8-9684-416e-ae0b-4ca237b104f1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Returning 404 to user: Instance 3b0c4ba6-607a-4213-adfc-22306c7c61bd could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:58.494198 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-855d28d8-9684-416e-ae0b-4ca237b104f1 tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd" status: 404 len: 111 microversion: 2.1 time: 0.030117 Dec 15 19:10:58.494727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 557/1189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:10:58 2021] GET /compute/v2.1/servers/3b0c4ba6-607a-4213-adfc-22306c7c61bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:10:58.502720 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-1868e56c-3d07-4ef0-9541-9fd9165b523b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] Calling method '.version_select at 0x7f80b61b7820>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:58.583231 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-1868e56c-3d07-4ef0-9541-9fd9165b523b tempest-TestMinimumBasicScenario-743529728 tempest-TestMinimumBasicScenario-743529728-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2060691409" status: 202 len: 0 microversion: 2.1 time: 0.084154 Dec 15 19:10:58.583809 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 633/1190] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Dec 15 19:10:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2060691409 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:10:58.939495 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-37d87ac6-cc5c-47f1-92fa-93ecdde98383 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:58.939991 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-37d87ac6-cc5c-47f1-92fa-93ecdde98383 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:58.949698 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37d87ac6-cc5c-47f1-92fa-93ecdde98383 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:58.950158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37d87ac6-cc5c-47f1-92fa-93ecdde98383 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:58.950961 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37d87ac6-cc5c-47f1-92fa-93ecdde98383 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:58.951851 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-37d87ac6-cc5c-47f1-92fa-93ecdde98383 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:58.965838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-37d87ac6-cc5c-47f1-92fa-93ecdde98383 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] HTTP exception thrown: Instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 could not be found. Dec 15 19:10:58.966388 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-37d87ac6-cc5c-47f1-92fa-93ecdde98383 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Returning 404 to user: Instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:58.967214 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-37d87ac6-cc5c-47f1-92fa-93ecdde98383 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 404 len: 111 microversion: 2.20 time: 0.031882 Dec 15 19:10:58.967876 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 558/1191] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Dec 15 19:10:58 2021] DELETE /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 19:10:58.976312 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0f7958de-8148-4559-b8b4-6f89f093383a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:10:58.977036 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0f7958de-8148-4559-b8b4-6f89f093383a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 2a8ea341-62ac-42cb-8ae6-b14554543d64] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:10:58.983966 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0f7958de-8148-4559-b8b4-6f89f093383a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:58.984410 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0f7958de-8148-4559-b8b4-6f89f093383a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:58.985286 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0f7958de-8148-4559-b8b4-6f89f093383a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:10:58.985715 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0f7958de-8148-4559-b8b4-6f89f093383a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:10:58.999054 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-0f7958de-8148-4559-b8b4-6f89f093383a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] HTTP exception thrown: Instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 could not be found. Dec 15 19:10:58.999645 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0f7958de-8148-4559-b8b4-6f89f093383a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Returning 404 to user: Instance 2a8ea341-62ac-42cb-8ae6-b14554543d64 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:10:59.000969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0f7958de-8148-4559-b8b4-6f89f093383a tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64" status: 404 len: 111 microversion: 2.20 time: 0.028035 Dec 15 19:10:59.001782 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 634/1192] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:10:58 2021] GET /compute/v2.1/servers/2a8ea341-62ac-42cb-8ae6-b14554543d64 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 19:11:00.276961 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-946c15e3-824e-4d86-9520-a9c54d13b4d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:00.277775 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-946c15e3-824e-4d86-9520-a9c54d13b4d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:00.286134 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-946c15e3-824e-4d86-9520-a9c54d13b4d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:00.286855 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-946c15e3-824e-4d86-9520-a9c54d13b4d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:00.287990 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-946c15e3-824e-4d86-9520-a9c54d13b4d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:00.288577 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-946c15e3-824e-4d86-9520-a9c54d13b4d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:00.306195 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-946c15e3-824e-4d86-9520-a9c54d13b4d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] HTTP exception thrown: Instance 93490542-6e11-41c3-9901-c06a1dd65cef could not be found. Dec 15 19:11:00.307161 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-946c15e3-824e-4d86-9520-a9c54d13b4d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Returning 404 to user: Instance 93490542-6e11-41c3-9901-c06a1dd65cef could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:11:00.308135 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-946c15e3-824e-4d86-9520-a9c54d13b4d5 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "DELETE /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 404 len: 111 microversion: 2.20 time: 0.035556 Dec 15 19:11:00.308857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 559/1193] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Dec 15 19:11:00 2021] DELETE /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 19:11:00.317247 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0ebf1295-b11b-4c05-9de9-a04b8be3d0f8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:00.318136 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0ebf1295-b11b-4c05-9de9-a04b8be3d0f8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] [instance: 93490542-6e11-41c3-9901-c06a1dd65cef] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:00.325073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0ebf1295-b11b-4c05-9de9-a04b8be3d0f8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:00.325567 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0ebf1295-b11b-4c05-9de9-a04b8be3d0f8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:00.326371 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0ebf1295-b11b-4c05-9de9-a04b8be3d0f8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:00.326811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0ebf1295-b11b-4c05-9de9-a04b8be3d0f8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:00.341234 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-0ebf1295-b11b-4c05-9de9-a04b8be3d0f8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] HTTP exception thrown: Instance 93490542-6e11-41c3-9901-c06a1dd65cef could not be found. Dec 15 19:11:00.341833 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0ebf1295-b11b-4c05-9de9-a04b8be3d0f8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] Returning 404 to user: Instance 93490542-6e11-41c3-9901-c06a1dd65cef could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:11:00.342656 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0ebf1295-b11b-4c05-9de9-a04b8be3d0f8 tempest-AttachVolumeShelveTestJSON-78701053 tempest-AttachVolumeShelveTestJSON-78701053-project] 10.222.0.49 "GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef" status: 404 len: 111 microversion: 2.20 time: 0.029509 Dec 15 19:11:00.343213 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 635/1194] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Dec 15 19:11:00 2021] GET /compute/v2.1/servers/93490542-6e11-41c3-9901-c06a1dd65cef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 19:11:24.246137 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4a6e6335-b670-4fd7-85e6-f67463b2e3db tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Action: 'create', calling method: .version_select at 0x7f80ba7acc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-2000091582"}} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:11:24.260818 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4a6e6335-b670-4fd7-85e6-f67463b2e3db tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Getting quotas for project e78f14ed60c847cb8e006926cc936940. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:11:24.265171 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4a6e6335-b670-4fd7-85e6-f67463b2e3db tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Getting quotas for user dcd2bd6bc5a94874a286d6deafb9f1e9 and project e78f14ed60c847cb8e006926cc936940. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:11:24.465847 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4a6e6335-b670-4fd7-85e6-f67463b2e3db tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Getting quotas for project e78f14ed60c847cb8e006926cc936940. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:11:24.477892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.quota [None req-4a6e6335-b670-4fd7-85e6-f67463b2e3db tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Getting quotas for user dcd2bd6bc5a94874a286d6deafb9f1e9 and project e78f14ed60c847cb8e006926cc936940. Resources: {'key_pairs'} {{(pid=116515) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:11:24.493434 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4a6e6335-b670-4fd7-85e6-f67463b2e3db tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.450249 Dec 15 19:11:24.494085 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 560/1195] 10.222.0.49 () {60 vars in 1157 bytes} [Wed Dec 15 19:11:24 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:41.461275 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-735204302", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-782438899", "security_groups": [{"name": "tempest-secgroup-smoke-39792596"}], "block_device_mapping_v2": [{"uuid": "b6bb8ad8-91f1-4c44-8281-f1db44af14b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f1ee251-b588-424c-abec-a3e47c426719"}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:11:41.585012 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] validate_networks() for [('8f1ee251-b588-424c-abec-a3e47c426719', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:11:42.001327 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:11:42.001914 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:11:42.002462 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:11:42.002947 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:11:42.003472 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:11:42.013247 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:42.014552 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:42.015498 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:42.015891 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:42.036692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:11:42.041068 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Getting quotas for user b7c21b8f3da14074949d2f6ba58b7204 and project f117be2c3e5e4d548c414fd1e198c1a4. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:11:42.117217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:11:42.117217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6bb8ad8-91f1-4c44-8281-f1db44af14b4',volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:11:42.589035 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7397b333-7df9-448c-9da7-d141de1c5ca7 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.131581 Dec 15 19:11:42.590468 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 636/1196] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:11:41 2021] POST /compute/v2.1/servers => generated 404 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:11:42.601361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f7c19df6-47a3-4931-8074-2292a1a7241f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:42.602672 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f7c19df6-47a3-4931-8074-2292a1a7241f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:42.679717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f7c19df6-47a3-4931-8074-2292a1a7241f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:42.691263 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f7c19df6-47a3-4931-8074-2292a1a7241f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1093 microversion: 2.1 time: 0.093849 Dec 15 19:11:42.692283 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 561/1197] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:42 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1093 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:43.709886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-35c00298-5e39-4f96-920a-746c03461efc tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:43.710533 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-35c00298-5e39-4f96-920a-746c03461efc tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:43.769218 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-35c00298-5e39-4f96-920a-746c03461efc tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:43.777334 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-35c00298-5e39-4f96-920a-746c03461efc tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1093 microversion: 2.1 time: 0.072019 Dec 15 19:11:43.788479 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 637/1198] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:43 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:44.794751 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-504d4f6a-2879-481f-84e4-b2aee3b38425 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:44.795361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-504d4f6a-2879-481f-84e4-b2aee3b38425 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:44.853561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-504d4f6a-2879-481f-84e4-b2aee3b38425 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:44.861232 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-504d4f6a-2879-481f-84e4-b2aee3b38425 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1093 microversion: 2.1 time: 0.070162 Dec 15 19:11:44.870683 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 562/1199] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:44 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:11:45.879161 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b446a911-b3c4-4f96-9bf1-6a066298b094 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:45.879704 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b446a911-b3c4-4f96-9bf1-6a066298b094 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:45.887109 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b446a911-b3c4-4f96-9bf1-6a066298b094 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:45.887727 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b446a911-b3c4-4f96-9bf1-6a066298b094 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:45.888555 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b446a911-b3c4-4f96-9bf1-6a066298b094 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:45.888996 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b446a911-b3c4-4f96-9bf1-6a066298b094 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:45.952973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b446a911-b3c4-4f96-9bf1-6a066298b094 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:45.960851 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b446a911-b3c4-4f96-9bf1-6a066298b094 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1143 microversion: 2.1 time: 0.085525 Dec 15 19:11:45.961439 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 638/1200] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:45 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:46.977951 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-701ae9f3-cf62-4357-ba17-fdbe1389b30b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:46.979140 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-701ae9f3-cf62-4357-ba17-fdbe1389b30b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:46.985831 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-701ae9f3-cf62-4357-ba17-fdbe1389b30b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:46.986943 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-701ae9f3-cf62-4357-ba17-fdbe1389b30b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:46.987761 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-701ae9f3-cf62-4357-ba17-fdbe1389b30b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:46.988385 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-701ae9f3-cf62-4357-ba17-fdbe1389b30b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:47.063767 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-701ae9f3-cf62-4357-ba17-fdbe1389b30b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:47.073477 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-701ae9f3-cf62-4357-ba17-fdbe1389b30b tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1135 microversion: 2.1 time: 0.099120 Dec 15 19:11:47.074165 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 563/1201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:46 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1135 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:48.091206 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2041399082", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2000091582", "security_groups": [{"name": "tempest-secgroup-smoke-620089369"}], "networks": [{"uuid": "90df79ab-8736-40c9-b55e-7513272101c7"}], "block_device_mapping_v2": [{"uuid": "d8246c78-44e0-447e-a62f-84e82cdb2c1c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:11:48.096097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c36d1b61-2fb3-4b7a-b173-642b1366a269 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:48.096097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c36d1b61-2fb3-4b7a-b173-642b1366a269 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:48.105985 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c36d1b61-2fb3-4b7a-b173-642b1366a269 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:48.106471 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c36d1b61-2fb3-4b7a-b173-642b1366a269 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:48.107312 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c36d1b61-2fb3-4b7a-b173-642b1366a269 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:48.107807 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c36d1b61-2fb3-4b7a-b173-642b1366a269 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:48.179811 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c36d1b61-2fb3-4b7a-b173-642b1366a269 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:48.186971 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c36d1b61-2fb3-4b7a-b173-642b1366a269 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1209 microversion: 2.1 time: 0.099802 Dec 15 19:11:48.187537 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 564/1202] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:48 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:48.483814 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] validate_networks() for [('90df79ab-8736-40c9-b55e-7513272101c7', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:11:49.141577 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:11:49.142183 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:11:49.143177 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:11:49.143657 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:11:49.144140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:11:49.152935 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:49.153608 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:49.154504 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:49.155066 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:49.173073 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Getting quotas for project e78f14ed60c847cb8e006926cc936940. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:11:49.177341 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Getting quotas for user dcd2bd6bc5a94874a286d6deafb9f1e9 and project e78f14ed60c847cb8e006926cc936940. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:11:49.204405 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6f097ad3-bce5-4d01-bb8a-13dccb59ba35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:49.205717 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6f097ad3-bce5-4d01-bb8a-13dccb59ba35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:49.212326 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f097ad3-bce5-4d01-bb8a-13dccb59ba35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:49.212770 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f097ad3-bce5-4d01-bb8a-13dccb59ba35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:49.213857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f097ad3-bce5-4d01-bb8a-13dccb59ba35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:49.214364 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f097ad3-bce5-4d01-bb8a-13dccb59ba35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:49.240715 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:11:49.242800 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8246c78-44e0-447e-a62f-84e82cdb2c1c',volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:11:49.366151 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6f097ad3-bce5-4d01-bb8a-13dccb59ba35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:49.373775 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6f097ad3-bce5-4d01-bb8a-13dccb59ba35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.172915 Dec 15 19:11:49.374350 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 565/1203] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:49 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:11:49.648984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e0b4f73a-125b-4652-aa83-9c2e3753d569 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.562010 Dec 15 19:11:49.649705 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 639/1204] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:11:48 2021] POST /compute/v2.1/servers => generated 405 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:11:49.659646 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9a1cb5c2-5ada-40eb-85aa-579e0b1b0608 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:49.660188 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9a1cb5c2-5ada-40eb-85aa-579e0b1b0608 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:49.721140 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9a1cb5c2-5ada-40eb-85aa-579e0b1b0608 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:49.728241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9a1cb5c2-5ada-40eb-85aa-579e0b1b0608 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1089 microversion: 2.1 time: 0.072317 Dec 15 19:11:49.729028 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 566/1205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:49 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:49.766146 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-3300d47d-4743-4995-8123-43a7aa4708f0 req-d54028fc-bc9f-4997-99ff-661f1cbfb018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70", "tag": "566463b4-e92a-40bf-9b9c-1e3562f26fbf"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:11:49.768529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:11:49.768529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:11:49.778347 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-3300d47d-4743-4995-8123-43a7aa4708f0 req-d54028fc-bc9f-4997-99ff-661f1cbfb018 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:49.778870 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-3300d47d-4743-4995-8123-43a7aa4708f0 req-d54028fc-bc9f-4997-99ff-661f1cbfb018 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:49.791492 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-3300d47d-4743-4995-8123-43a7aa4708f0 req-d54028fc-bc9f-4997-99ff-661f1cbfb018 service nova] Creating event network-changed:566463b4-e92a-40bf-9b9c-1e3562f26fbf for instance e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 on hv-cinder-81268 Dec 15 19:11:49.799390 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-3300d47d-4743-4995-8123-43a7aa4708f0 req-d54028fc-bc9f-4997-99ff-661f1cbfb018 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034386 Dec 15 19:11:49.802873 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 640/1206] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:11:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:11:50.394784 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c686fcfd-5812-4c9e-ac96-9e122b440d6e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:50.395406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c686fcfd-5812-4c9e-ac96-9e122b440d6e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:50.401694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c686fcfd-5812-4c9e-ac96-9e122b440d6e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:50.402158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c686fcfd-5812-4c9e-ac96-9e122b440d6e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:50.402941 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c686fcfd-5812-4c9e-ac96-9e122b440d6e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:50.403406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c686fcfd-5812-4c9e-ac96-9e122b440d6e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:50.569613 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c686fcfd-5812-4c9e-ac96-9e122b440d6e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:50.577552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c686fcfd-5812-4c9e-ac96-9e122b440d6e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.188882 Dec 15 19:11:50.587748 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 567/1207] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:50 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:50.747875 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f35d8df3-9fe6-412d-a75f-a6a269b9c554 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:50.748580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f35d8df3-9fe6-412d-a75f-a6a269b9c554 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:50.810995 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f35d8df3-9fe6-412d-a75f-a6a269b9c554 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:50.818244 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f35d8df3-9fe6-412d-a75f-a6a269b9c554 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1089 microversion: 2.1 time: 0.074995 Dec 15 19:11:50.819085 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 641/1208] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:50 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:51.594670 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-47043cbf-fd23-4cf5-a120-04f8891dc475 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:51.596614 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-47043cbf-fd23-4cf5-a120-04f8891dc475 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:51.603375 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-47043cbf-fd23-4cf5-a120-04f8891dc475 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:51.603836 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-47043cbf-fd23-4cf5-a120-04f8891dc475 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:51.604599 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-47043cbf-fd23-4cf5-a120-04f8891dc475 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:51.605052 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-47043cbf-fd23-4cf5-a120-04f8891dc475 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:51.837910 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-07f393d6-ea2a-4777-83ff-93dc28a8b788 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:51.837910 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-07f393d6-ea2a-4777-83ff-93dc28a8b788 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:51.854432 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-07f393d6-ea2a-4777-83ff-93dc28a8b788 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:51.854884 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-07f393d6-ea2a-4777-83ff-93dc28a8b788 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:51.859358 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-07f393d6-ea2a-4777-83ff-93dc28a8b788 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:51.861517 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-07f393d6-ea2a-4777-83ff-93dc28a8b788 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:51.915477 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-47043cbf-fd23-4cf5-a120-04f8891dc475 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:51.923150 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-47043cbf-fd23-4cf5-a120-04f8891dc475 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.332113 Dec 15 19:11:51.930284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 568/1209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:51 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:51.930921 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-07f393d6-ea2a-4777-83ff-93dc28a8b788 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:51.938310 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-07f393d6-ea2a-4777-83ff-93dc28a8b788 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1187 microversion: 2.1 time: 0.105523 Dec 15 19:11:51.938881 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 642/1210] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:51 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:52.939721 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-43141ade-6098-4120-85b0-0c8b304bea35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:52.940335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-43141ade-6098-4120-85b0-0c8b304bea35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:52.946885 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-43141ade-6098-4120-85b0-0c8b304bea35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:52.947414 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-43141ade-6098-4120-85b0-0c8b304bea35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:52.948209 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-43141ade-6098-4120-85b0-0c8b304bea35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:52.948718 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-43141ade-6098-4120-85b0-0c8b304bea35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:52.963186 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-3bce4091-34e4-408c-8773-6a96c2a8fa9d tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:52.969898 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-3bce4091-34e4-408c-8773-6a96c2a8fa9d tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:52.988481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3bce4091-34e4-408c-8773-6a96c2a8fa9d tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:52.989031 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3bce4091-34e4-408c-8773-6a96c2a8fa9d tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:52.989973 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3bce4091-34e4-408c-8773-6a96c2a8fa9d tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:52.990420 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-3bce4091-34e4-408c-8773-6a96c2a8fa9d tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:53.108724 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-43141ade-6098-4120-85b0-0c8b304bea35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:53.116583 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-43141ade-6098-4120-85b0-0c8b304bea35 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.180588 Dec 15 19:11:53.117222 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 569/1211] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:52 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:53.288344 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-3bce4091-34e4-408c-8773-6a96c2a8fa9d tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:53.295975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-3bce4091-34e4-408c-8773-6a96c2a8fa9d tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1272 microversion: 2.1 time: 0.343016 Dec 15 19:11:53.296827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 643/1212] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:52 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:53.845307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-78d6f2b2-86ed-4dba-bff7-02931ac18572 req-268b4875-af11-4d88-af86-4a7370d89240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6128c912-1a49-4e44-add6-bcd197f85063", "tag": "1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:11:53.846985 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:11:53.846985 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:11:53.853962 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-78d6f2b2-86ed-4dba-bff7-02931ac18572 req-268b4875-af11-4d88-af86-4a7370d89240 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:53.854408 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-78d6f2b2-86ed-4dba-bff7-02931ac18572 req-268b4875-af11-4d88-af86-4a7370d89240 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:53.866688 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-78d6f2b2-86ed-4dba-bff7-02931ac18572 req-268b4875-af11-4d88-af86-4a7370d89240 service nova] Creating event network-changed:1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9 for instance 6128c912-1a49-4e44-add6-bcd197f85063 on hv-cinder-81268 Dec 15 19:11:53.871696 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-78d6f2b2-86ed-4dba-bff7-02931ac18572 req-268b4875-af11-4d88-af86-4a7370d89240 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030686 Dec 15 19:11:53.872552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 570/1213] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:11:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:11:54.133591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b8d95f37-a94a-49b8-9022-eee688bc0a97 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:54.134752 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b8d95f37-a94a-49b8-9022-eee688bc0a97 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:54.140922 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b8d95f37-a94a-49b8-9022-eee688bc0a97 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:54.141492 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b8d95f37-a94a-49b8-9022-eee688bc0a97 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:54.142417 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b8d95f37-a94a-49b8-9022-eee688bc0a97 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:54.142926 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b8d95f37-a94a-49b8-9022-eee688bc0a97 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:54.169352 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:11:54.169868 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: Wed Dec 15 19:11:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:11:54.314645 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0cd8ed03-fbf6-45c8-a93c-3f753a5d1979 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:54.315620 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0cd8ed03-fbf6-45c8-a93c-3f753a5d1979 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:54.323011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0cd8ed03-fbf6-45c8-a93c-3f753a5d1979 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:54.323580 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0cd8ed03-fbf6-45c8-a93c-3f753a5d1979 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:54.324475 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0cd8ed03-fbf6-45c8-a93c-3f753a5d1979 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:54.325051 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0cd8ed03-fbf6-45c8-a93c-3f753a5d1979 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:54.387399 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b8d95f37-a94a-49b8-9022-eee688bc0a97 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:54.395116 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b8d95f37-a94a-49b8-9022-eee688bc0a97 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.264986 Dec 15 19:11:54.395810 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 644/1214] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:54 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:54.513194 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0cd8ed03-fbf6-45c8-a93c-3f753a5d1979 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:54.520923 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0cd8ed03-fbf6-45c8-a93c-3f753a5d1979 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.210781 Dec 15 19:11:54.521753 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 571/1215] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:54 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:11:55.414358 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-c74210a0-d7ea-4486-8b73-a16676e51b7e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:55.415032 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-c74210a0-d7ea-4486-8b73-a16676e51b7e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:55.421915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c74210a0-d7ea-4486-8b73-a16676e51b7e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:55.422241 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c74210a0-d7ea-4486-8b73-a16676e51b7e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:55.423047 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c74210a0-d7ea-4486-8b73-a16676e51b7e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:55.424049 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-c74210a0-d7ea-4486-8b73-a16676e51b7e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:55.540509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3424c385-3b57-4e5e-9457-f4456fb62def tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:55.541142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3424c385-3b57-4e5e-9457-f4456fb62def tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:55.547364 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3424c385-3b57-4e5e-9457-f4456fb62def tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:55.547816 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3424c385-3b57-4e5e-9457-f4456fb62def tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:55.554653 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3424c385-3b57-4e5e-9457-f4456fb62def tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:55.555113 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3424c385-3b57-4e5e-9457-f4456fb62def tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:55.605329 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-c74210a0-d7ea-4486-8b73-a16676e51b7e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:55.613373 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-c74210a0-d7ea-4486-8b73-a16676e51b7e tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.202694 Dec 15 19:11:55.614012 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 645/1216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:55 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:55.694225 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3424c385-3b57-4e5e-9457-f4456fb62def tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:55.712051 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3424c385-3b57-4e5e-9457-f4456fb62def tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.175115 Dec 15 19:11:55.713154 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 572/1217] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:55 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:11:56.630176 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d3257964-14b9-43ac-99e5-e34964c958d6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:56.630820 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d3257964-14b9-43ac-99e5-e34964c958d6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:56.637069 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d3257964-14b9-43ac-99e5-e34964c958d6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:56.641326 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d3257964-14b9-43ac-99e5-e34964c958d6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:56.641326 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d3257964-14b9-43ac-99e5-e34964c958d6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:56.641785 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d3257964-14b9-43ac-99e5-e34964c958d6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:56.728468 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1196feaf-b53e-40f9-b6ef-adfdc9491ca2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:56.729675 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1196feaf-b53e-40f9-b6ef-adfdc9491ca2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:56.737447 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1196feaf-b53e-40f9-b6ef-adfdc9491ca2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:56.737910 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1196feaf-b53e-40f9-b6ef-adfdc9491ca2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:56.738707 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1196feaf-b53e-40f9-b6ef-adfdc9491ca2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:56.739139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1196feaf-b53e-40f9-b6ef-adfdc9491ca2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:56.795811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d3257964-14b9-43ac-99e5-e34964c958d6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:56.804053 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d3257964-14b9-43ac-99e5-e34964c958d6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.178050 Dec 15 19:11:56.804628 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 646/1218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:56 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:56.876335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1196feaf-b53e-40f9-b6ef-adfdc9491ca2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:56.883757 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1196feaf-b53e-40f9-b6ef-adfdc9491ca2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.158897 Dec 15 19:11:56.885119 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 573/1219] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:56 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:57.821475 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-eb86b9b7-da89-466b-a3af-457433819af4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:57.822081 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-eb86b9b7-da89-466b-a3af-457433819af4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:57.828217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-eb86b9b7-da89-466b-a3af-457433819af4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:57.828664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-eb86b9b7-da89-466b-a3af-457433819af4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:57.829460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-eb86b9b7-da89-466b-a3af-457433819af4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:57.829895 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-eb86b9b7-da89-466b-a3af-457433819af4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:57.901746 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-630e9668-552f-4c2a-8f76-3d3d5adc931b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:57.902359 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-630e9668-552f-4c2a-8f76-3d3d5adc931b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:57.910341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-630e9668-552f-4c2a-8f76-3d3d5adc931b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:57.910804 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-630e9668-552f-4c2a-8f76-3d3d5adc931b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:57.911600 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-630e9668-552f-4c2a-8f76-3d3d5adc931b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:57.912040 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-630e9668-552f-4c2a-8f76-3d3d5adc931b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:57.965393 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-eb86b9b7-da89-466b-a3af-457433819af4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:57.979613 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-eb86b9b7-da89-466b-a3af-457433819af4 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.161737 Dec 15 19:11:57.980332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 647/1220] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:57 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:58.136901 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-630e9668-552f-4c2a-8f76-3d3d5adc931b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:58.144490 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-630e9668-552f-4c2a-8f76-3d3d5adc931b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.246478 Dec 15 19:11:58.145073 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 574/1221] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:57 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:11:58.998009 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d7e49e1d-3a61-44c1-b058-f82de8671353 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:58.998637 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d7e49e1d-3a61-44c1-b058-f82de8671353 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:59.005499 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7e49e1d-3a61-44c1-b058-f82de8671353 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:59.005949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7e49e1d-3a61-44c1-b058-f82de8671353 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:59.006758 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7e49e1d-3a61-44c1-b058-f82de8671353 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:59.007186 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d7e49e1d-3a61-44c1-b058-f82de8671353 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:59.156793 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d7e49e1d-3a61-44c1-b058-f82de8671353 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:59.160932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e265bed7-ac55-4f29-984c-d3f825bee09c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:11:59.161595 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e265bed7-ac55-4f29-984c-d3f825bee09c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:11:59.164746 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d7e49e1d-3a61-44c1-b058-f82de8671353 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.170495 Dec 15 19:11:59.165451 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 648/1222] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:58 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:11:59.168148 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e265bed7-ac55-4f29-984c-d3f825bee09c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:59.168786 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e265bed7-ac55-4f29-984c-d3f825bee09c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:59.169642 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e265bed7-ac55-4f29-984c-d3f825bee09c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:11:59.170088 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e265bed7-ac55-4f29-984c-d3f825bee09c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:11:59.306010 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e265bed7-ac55-4f29-984c-d3f825bee09c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:11:59.314655 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e265bed7-ac55-4f29-984c-d3f825bee09c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.157543 Dec 15 19:11:59.315331 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 575/1223] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:11:59 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:00.182291 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b7f1bb75-f9d7-4f3d-a638-66001d465c9a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:00.185381 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b7f1bb75-f9d7-4f3d-a638-66001d465c9a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:00.189509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7f1bb75-f9d7-4f3d-a638-66001d465c9a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:00.190024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7f1bb75-f9d7-4f3d-a638-66001d465c9a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:00.190824 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7f1bb75-f9d7-4f3d-a638-66001d465c9a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:00.191443 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7f1bb75-f9d7-4f3d-a638-66001d465c9a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:00.327082 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b7f1bb75-f9d7-4f3d-a638-66001d465c9a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:00.331838 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4bf73174-1dfb-4021-af57-5be5cbcdbd69 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:00.332453 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4bf73174-1dfb-4021-af57-5be5cbcdbd69 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:00.336664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b7f1bb75-f9d7-4f3d-a638-66001d465c9a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.158049 Dec 15 19:12:00.338065 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 649/1224] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:00 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:00.338608 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4bf73174-1dfb-4021-af57-5be5cbcdbd69 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:00.339447 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4bf73174-1dfb-4021-af57-5be5cbcdbd69 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:00.339852 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4bf73174-1dfb-4021-af57-5be5cbcdbd69 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:00.340293 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4bf73174-1dfb-4021-af57-5be5cbcdbd69 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:00.471065 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4bf73174-1dfb-4021-af57-5be5cbcdbd69 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:00.478346 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4bf73174-1dfb-4021-af57-5be5cbcdbd69 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.150697 Dec 15 19:12:00.478902 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 576/1225] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:00 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:01.018088 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-850673441", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "networks": [{"uuid": "c5253451-6588-47e6-8d09-495adf4b3ded"}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:01.070977 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] validate_networks() for [('c5253451-6588-47e6-8d09-495adf4b3ded', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:12:01.356027 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3a1cd978-72c2-4074-83dd-8b6dcdc61d67 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:01.357233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3a1cd978-72c2-4074-83dd-8b6dcdc61d67 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:01.364561 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3a1cd978-72c2-4074-83dd-8b6dcdc61d67 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:01.365014 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3a1cd978-72c2-4074-83dd-8b6dcdc61d67 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:01.365868 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3a1cd978-72c2-4074-83dd-8b6dcdc61d67 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:01.366307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3a1cd978-72c2-4074-83dd-8b6dcdc61d67 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:01.424812 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:12:01.425335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:12:01.425740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:12:01.426147 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:12:01.426621 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:12:01.436575 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:01.436948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:01.437840 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:01.438276 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:01.455617 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Getting quotas for project 6d24ab04ab414e69844313a3ecc8e946. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:12:01.459626 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Getting quotas for user 7d383e3982904d5a893c6eec056fe494 and project 6d24ab04ab414e69844313a3ecc8e946. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:12:01.473630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:12:01.476272 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:12:01.515562 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3a1cd978-72c2-4074-83dd-8b6dcdc61d67 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:01.523390 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3a1cd978-72c2-4074-83dd-8b6dcdc61d67 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.173048 Dec 15 19:12:01.524030 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 577/1226] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:01 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:01.528457 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8e64b04d-45f0-42d8-b5ef-e86afd7248b4 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:01.529250 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8e64b04d-45f0-42d8-b5ef-e86afd7248b4 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:01.535744 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8e64b04d-45f0-42d8-b5ef-e86afd7248b4 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:01.536194 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8e64b04d-45f0-42d8-b5ef-e86afd7248b4 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:01.536975 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8e64b04d-45f0-42d8-b5ef-e86afd7248b4 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:01.537441 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8e64b04d-45f0-42d8-b5ef-e86afd7248b4 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:01.608468 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-5ff80453-fefa-4d97-a021-ed993c432a27 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594012 Dec 15 19:12:01.609440 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 650/1227] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:12:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 19:12:01.619399 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fd256a32-b05b-40bd-bfbe-890e89939547 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:01.620194 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fd256a32-b05b-40bd-bfbe-890e89939547 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:01.679470 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8e64b04d-45f0-42d8-b5ef-e86afd7248b4 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:01.683765 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fd256a32-b05b-40bd-bfbe-890e89939547 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:01.690042 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8e64b04d-45f0-42d8-b5ef-e86afd7248b4 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.164997 Dec 15 19:12:01.690725 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 578/1228] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:01 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:01.692005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fd256a32-b05b-40bd-bfbe-890e89939547 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1213 microversion: 2.1 time: 0.076251 Dec 15 19:12:01.692561 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 651/1229] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:01 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:02.408775 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-6b464fc8-2823-4614-980c-9a32d8f6c23a req-83e89f9f-94d9-40ee-886b-0ca4887b2041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70", "name": "network-vif-plugged", "status": "completed", "tag": "566463b4-e92a-40bf-9b9c-1e3562f26fbf"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:02.411353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:02.411353 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:12:02.418624 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-6b464fc8-2823-4614-980c-9a32d8f6c23a req-83e89f9f-94d9-40ee-886b-0ca4887b2041 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:02.419066 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-6b464fc8-2823-4614-980c-9a32d8f6c23a req-83e89f9f-94d9-40ee-886b-0ca4887b2041 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:02.430205 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-6b464fc8-2823-4614-980c-9a32d8f6c23a req-83e89f9f-94d9-40ee-886b-0ca4887b2041 service nova] Creating event network-vif-plugged:566463b4-e92a-40bf-9b9c-1e3562f26fbf for instance e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 on hv-cinder-81268 Dec 15 19:12:02.434998 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-6b464fc8-2823-4614-980c-9a32d8f6c23a req-83e89f9f-94d9-40ee-886b-0ca4887b2041 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029851 Dec 15 19:12:02.435568 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 579/1230] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:02.544866 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-bb97ae03-6071-46d7-abc3-82c5c45d4545 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:02.546063 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-bb97ae03-6071-46d7-abc3-82c5c45d4545 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:02.553943 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bb97ae03-6071-46d7-abc3-82c5c45d4545 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:02.554397 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bb97ae03-6071-46d7-abc3-82c5c45d4545 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:02.555188 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bb97ae03-6071-46d7-abc3-82c5c45d4545 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:02.555656 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-bb97ae03-6071-46d7-abc3-82c5c45d4545 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:02.689462 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-bb97ae03-6071-46d7-abc3-82c5c45d4545 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:02.696848 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-bb97ae03-6071-46d7-abc3-82c5c45d4545 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.155740 Dec 15 19:12:02.697481 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 652/1231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:02 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:02.707665 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e7094ed8-cc27-489d-80d6-63f2421292d0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:02.708360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e7094ed8-cc27-489d-80d6-63f2421292d0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:02.712569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-904113fb-aad2-4fa1-b330-433525a8cfd6 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:02.716225 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-904113fb-aad2-4fa1-b330-433525a8cfd6 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:02.716362 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7094ed8-cc27-489d-80d6-63f2421292d0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:02.716362 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7094ed8-cc27-489d-80d6-63f2421292d0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:02.716362 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7094ed8-cc27-489d-80d6-63f2421292d0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:02.717012 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e7094ed8-cc27-489d-80d6-63f2421292d0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:02.720776 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-904113fb-aad2-4fa1-b330-433525a8cfd6 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:02.721477 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-904113fb-aad2-4fa1-b330-433525a8cfd6 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:02.722709 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-904113fb-aad2-4fa1-b330-433525a8cfd6 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:02.723501 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-904113fb-aad2-4fa1-b330-433525a8cfd6 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:02.793231 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-904113fb-aad2-4fa1-b330-433525a8cfd6 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:02.816646 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-904113fb-aad2-4fa1-b330-433525a8cfd6 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1217 microversion: 2.1 time: 0.094267 Dec 15 19:12:02.816646 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 653/1232] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:02 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:02.855912 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-e7094ed8-cc27-489d-80d6-63f2421292d0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:02.864136 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e7094ed8-cc27-489d-80d6-63f2421292d0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.160427 Dec 15 19:12:02.864708 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 580/1233] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:02 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:03.713330 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ef175798-53a4-49b6-ad52-c3d2bd76e05a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:03.713860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ef175798-53a4-49b6-ad52-c3d2bd76e05a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:03.720304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef175798-53a4-49b6-ad52-c3d2bd76e05a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:03.720765 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef175798-53a4-49b6-ad52-c3d2bd76e05a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:03.721623 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef175798-53a4-49b6-ad52-c3d2bd76e05a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:03.722060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ef175798-53a4-49b6-ad52-c3d2bd76e05a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:03.819262 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-609c18bb-3a90-43cb-a261-fdca3873fc0e tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:03.819863 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-609c18bb-3a90-43cb-a261-fdca3873fc0e tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:03.825898 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-609c18bb-3a90-43cb-a261-fdca3873fc0e tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:03.826341 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-609c18bb-3a90-43cb-a261-fdca3873fc0e tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:03.827111 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-609c18bb-3a90-43cb-a261-fdca3873fc0e tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:03.827540 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-609c18bb-3a90-43cb-a261-fdca3873fc0e tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:03.859530 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ef175798-53a4-49b6-ad52-c3d2bd76e05a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:03.868094 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ef175798-53a4-49b6-ad52-c3d2bd76e05a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.158442 Dec 15 19:12:03.868669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 654/1234] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:03 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:03.881381 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6fe9537d-568d-4fde-968c-bffcec740656 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:03.883745 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6fe9537d-568d-4fde-968c-bffcec740656 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:03.894156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fe9537d-568d-4fde-968c-bffcec740656 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:03.895451 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fe9537d-568d-4fde-968c-bffcec740656 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:03.896256 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fe9537d-568d-4fde-968c-bffcec740656 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:03.896686 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6fe9537d-568d-4fde-968c-bffcec740656 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:03.898356 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-609c18bb-3a90-43cb-a261-fdca3873fc0e tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:03.905652 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-609c18bb-3a90-43cb-a261-fdca3873fc0e tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1265 microversion: 2.1 time: 0.090167 Dec 15 19:12:03.906218 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 581/1235] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:03 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:04.127568 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6fe9537d-568d-4fde-968c-bffcec740656 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:04.135042 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6fe9537d-568d-4fde-968c-bffcec740656 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.257199 Dec 15 19:12:04.135615 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 655/1236] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:03 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:04.885257 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f9723832-8bb2-44ad-bd14-0fc2130b2465 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:04.890264 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f9723832-8bb2-44ad-bd14-0fc2130b2465 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:04.892814 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9723832-8bb2-44ad-bd14-0fc2130b2465 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:04.893297 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9723832-8bb2-44ad-bd14-0fc2130b2465 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:04.894090 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9723832-8bb2-44ad-bd14-0fc2130b2465 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:04.894532 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f9723832-8bb2-44ad-bd14-0fc2130b2465 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:04.923056 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-859fcd5c-f309-4db2-9647-f36365efc81f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:04.924285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-859fcd5c-f309-4db2-9647-f36365efc81f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:04.931466 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-859fcd5c-f309-4db2-9647-f36365efc81f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:04.931933 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-859fcd5c-f309-4db2-9647-f36365efc81f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:04.932733 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-859fcd5c-f309-4db2-9647-f36365efc81f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:04.933193 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-859fcd5c-f309-4db2-9647-f36365efc81f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:05.032502 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f9723832-8bb2-44ad-bd14-0fc2130b2465 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:05.039943 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f9723832-8bb2-44ad-bd14-0fc2130b2465 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1263 microversion: 2.1 time: 0.158415 Dec 15 19:12:05.040588 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 582/1237] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:04 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:05.151749 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4aeb5dc6-17b1-463a-89b2-481c07ba187e tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:05.152373 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4aeb5dc6-17b1-463a-89b2-481c07ba187e tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:05.158331 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4aeb5dc6-17b1-463a-89b2-481c07ba187e tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:05.158787 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4aeb5dc6-17b1-463a-89b2-481c07ba187e tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:05.159570 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4aeb5dc6-17b1-463a-89b2-481c07ba187e tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:05.160009 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4aeb5dc6-17b1-463a-89b2-481c07ba187e tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:05.198967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-859fcd5c-f309-4db2-9647-f36365efc81f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:05.207878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-859fcd5c-f309-4db2-9647-f36365efc81f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.288634 Dec 15 19:12:05.208456 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 656/1238] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:04 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:05.294533 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4aeb5dc6-17b1-463a-89b2-481c07ba187e tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:05.302520 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4aeb5dc6-17b1-463a-89b2-481c07ba187e tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.154536 Dec 15 19:12:05.303089 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 583/1239] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:05 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:05.716504 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-05e47544-7665-407d-8a52-7d3aec2919fe req-37f9ada7-c704-454b-90cf-e5e52385eb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bffb4aed-e9be-4716-a597-482f00777b32", "tag": "9f9d0581-f26f-4922-957e-adc9da3e70df"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:05.718122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:05.718122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:12:05.726064 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-05e47544-7665-407d-8a52-7d3aec2919fe req-37f9ada7-c704-454b-90cf-e5e52385eb57 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:05.726527 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-05e47544-7665-407d-8a52-7d3aec2919fe req-37f9ada7-c704-454b-90cf-e5e52385eb57 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:05.738483 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-05e47544-7665-407d-8a52-7d3aec2919fe req-37f9ada7-c704-454b-90cf-e5e52385eb57 service nova] Creating event network-changed:9f9d0581-f26f-4922-957e-adc9da3e70df for instance bffb4aed-e9be-4716-a597-482f00777b32 on hv-cinder-81268 Dec 15 19:12:05.743216 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-05e47544-7665-407d-8a52-7d3aec2919fe req-37f9ada7-c704-454b-90cf-e5e52385eb57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030533 Dec 15 19:12:05.743939 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 657/1240] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:06.056979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c9d273af-f15f-4476-af61-4616ee50c702 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:06.057672 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c9d273af-f15f-4476-af61-4616ee50c702 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:06.064233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c9d273af-f15f-4476-af61-4616ee50c702 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:06.064689 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c9d273af-f15f-4476-af61-4616ee50c702 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:06.065549 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c9d273af-f15f-4476-af61-4616ee50c702 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:06.065988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c9d273af-f15f-4476-af61-4616ee50c702 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:06.198668 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c9d273af-f15f-4476-af61-4616ee50c702 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:06.206507 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c9d273af-f15f-4476-af61-4616ee50c702 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1449 microversion: 2.1 time: 0.153322 Dec 15 19:12:06.207063 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 584/1241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:06 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:06.223859 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ce21426a-7d1a-40c5-959a-d7d0082207ac tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:06.224561 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ce21426a-7d1a-40c5-959a-d7d0082207ac tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:06.225116 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ae7d1e0d-935c-4391-9391-11f441c1a01b tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:06.225816 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ae7d1e0d-935c-4391-9391-11f441c1a01b tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:06.231446 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ce21426a-7d1a-40c5-959a-d7d0082207ac tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:06.232001 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae7d1e0d-935c-4391-9391-11f441c1a01b tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:06.232190 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ce21426a-7d1a-40c5-959a-d7d0082207ac tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:06.232585 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae7d1e0d-935c-4391-9391-11f441c1a01b tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:06.232989 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ce21426a-7d1a-40c5-959a-d7d0082207ac tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:06.233463 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ce21426a-7d1a-40c5-959a-d7d0082207ac tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:06.233572 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae7d1e0d-935c-4391-9391-11f441c1a01b tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:06.234035 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ae7d1e0d-935c-4391-9391-11f441c1a01b tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:06.372879 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ae7d1e0d-935c-4391-9391-11f441c1a01b tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:06.381596 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ae7d1e0d-935c-4391-9391-11f441c1a01b tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.160161 Dec 15 19:12:06.382164 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 585/1242] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:06 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:06.391102 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-456a3def-11ee-4785-a707-c408c4e58203 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:06.391102 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-456a3def-11ee-4785-a707-c408c4e58203 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:06.393355 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-456a3def-11ee-4785-a707-c408c4e58203 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:06.393803 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-456a3def-11ee-4785-a707-c408c4e58203 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:06.394623 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-456a3def-11ee-4785-a707-c408c4e58203 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:06.395055 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-456a3def-11ee-4785-a707-c408c4e58203 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:06.458411 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ce21426a-7d1a-40c5-959a-d7d0082207ac tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:06.466289 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ce21426a-7d1a-40c5-959a-d7d0082207ac tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1449 microversion: 2.1 time: 0.247170 Dec 15 19:12:06.467045 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 658/1243] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:06 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1449 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:06.545644 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-456a3def-11ee-4785-a707-c408c4e58203 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:06.553195 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-456a3def-11ee-4785-a707-c408c4e58203 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.170068 Dec 15 19:12:06.553752 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 586/1244] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:06 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:07.398559 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-44c14151-76c3-4bf2-b73b-906880b80a87 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:07.399140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-44c14151-76c3-4bf2-b73b-906880b80a87 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:07.405463 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-44c14151-76c3-4bf2-b73b-906880b80a87 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:07.405919 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-44c14151-76c3-4bf2-b73b-906880b80a87 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:07.406840 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-44c14151-76c3-4bf2-b73b-906880b80a87 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:07.407702 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-44c14151-76c3-4bf2-b73b-906880b80a87 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:07.569698 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-eb89f67f-6360-418b-a6c4-266eaab30bac tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:07.570231 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-eb89f67f-6360-418b-a6c4-266eaab30bac tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:07.576424 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eb89f67f-6360-418b-a6c4-266eaab30bac tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:07.576873 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eb89f67f-6360-418b-a6c4-266eaab30bac tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:07.577689 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eb89f67f-6360-418b-a6c4-266eaab30bac tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:07.578126 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-eb89f67f-6360-418b-a6c4-266eaab30bac tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:07.648001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-44c14151-76c3-4bf2-b73b-906880b80a87 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:07.656423 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-44c14151-76c3-4bf2-b73b-906880b80a87 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.261468 Dec 15 19:12:07.667944 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 659/1245] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:07 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:07.716360 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-eb89f67f-6360-418b-a6c4-266eaab30bac tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:07.724406 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-eb89f67f-6360-418b-a6c4-266eaab30bac tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.158438 Dec 15 19:12:07.724979 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 587/1246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:07 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:08.675013 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4ce76f9e-da2c-4d98-8e90-09b976e9f2c9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:08.678117 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4ce76f9e-da2c-4d98-8e90-09b976e9f2c9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:08.686111 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4ce76f9e-da2c-4d98-8e90-09b976e9f2c9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:08.686871 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4ce76f9e-da2c-4d98-8e90-09b976e9f2c9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:08.688129 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4ce76f9e-da2c-4d98-8e90-09b976e9f2c9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:08.688586 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4ce76f9e-da2c-4d98-8e90-09b976e9f2c9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:08.721520 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-2b28de27-f2d5-4858-b345-c1241106edfe req-dcca59ee-4273-48e0-b2d0-9b91dede5f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70", "tag": "566463b4-e92a-40bf-9b9c-1e3562f26fbf"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:08.721520 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:08.721520 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:12:08.728488 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-2b28de27-f2d5-4858-b345-c1241106edfe req-dcca59ee-4273-48e0-b2d0-9b91dede5f0e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:08.728937 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-2b28de27-f2d5-4858-b345-c1241106edfe req-dcca59ee-4273-48e0-b2d0-9b91dede5f0e service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:08.742252 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-2b28de27-f2d5-4858-b345-c1241106edfe req-dcca59ee-4273-48e0-b2d0-9b91dede5f0e service nova] Creating event network-changed:566463b4-e92a-40bf-9b9c-1e3562f26fbf for instance e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 on hv-cinder-81268 Dec 15 19:12:08.747291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-2b28de27-f2d5-4858-b345-c1241106edfe req-dcca59ee-4273-48e0-b2d0-9b91dede5f0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031780 Dec 15 19:12:08.748417 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 588/1247] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:08.754301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c46fa6fc-c897-4a10-8c5b-c0f29b741324 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:08.755190 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c46fa6fc-c897-4a10-8c5b-c0f29b741324 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:08.761708 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c46fa6fc-c897-4a10-8c5b-c0f29b741324 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:08.762167 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c46fa6fc-c897-4a10-8c5b-c0f29b741324 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:08.762965 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c46fa6fc-c897-4a10-8c5b-c0f29b741324 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:08.763400 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c46fa6fc-c897-4a10-8c5b-c0f29b741324 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:08.861296 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4ce76f9e-da2c-4d98-8e90-09b976e9f2c9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:08.871277 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4ce76f9e-da2c-4d98-8e90-09b976e9f2c9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.201155 Dec 15 19:12:08.872461 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 660/1248] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:08 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:08.914944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-c46fa6fc-c897-4a10-8c5b-c0f29b741324 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:08.922332 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c46fa6fc-c897-4a10-8c5b-c0f29b741324 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.172483 Dec 15 19:12:08.922985 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 589/1249] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:08 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:09.887853 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7b0dd8e1-8268-4d57-b279-cb77dce03507 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:09.888401 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7b0dd8e1-8268-4d57-b279-cb77dce03507 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:09.894312 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7b0dd8e1-8268-4d57-b279-cb77dce03507 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:09.895502 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7b0dd8e1-8268-4d57-b279-cb77dce03507 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:09.896363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7b0dd8e1-8268-4d57-b279-cb77dce03507 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:09.896806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7b0dd8e1-8268-4d57-b279-cb77dce03507 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:09.939880 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-fcb82981-1053-4b8f-8129-38604b73bb4b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:09.940481 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-fcb82981-1053-4b8f-8129-38604b73bb4b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:09.946743 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcb82981-1053-4b8f-8129-38604b73bb4b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:09.947191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcb82981-1053-4b8f-8129-38604b73bb4b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:09.948000 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcb82981-1053-4b8f-8129-38604b73bb4b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:09.948433 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-fcb82981-1053-4b8f-8129-38604b73bb4b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:10.029544 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7b0dd8e1-8268-4d57-b279-cb77dce03507 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:10.037736 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7b0dd8e1-8268-4d57-b279-cb77dce03507 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.153852 Dec 15 19:12:10.038307 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 661/1250] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:09 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:10.085064 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-fcb82981-1053-4b8f-8129-38604b73bb4b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:10.092371 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-fcb82981-1053-4b8f-8129-38604b73bb4b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.156790 Dec 15 19:12:10.092935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 590/1251] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:09 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:11.053846 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d2929977-fc84-4fd1-b071-d922afc66c22 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:11.054458 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d2929977-fc84-4fd1-b071-d922afc66c22 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:11.060794 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d2929977-fc84-4fd1-b071-d922afc66c22 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:11.061399 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d2929977-fc84-4fd1-b071-d922afc66c22 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:11.062053 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d2929977-fc84-4fd1-b071-d922afc66c22 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:11.062493 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d2929977-fc84-4fd1-b071-d922afc66c22 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:11.110441 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9b61b8fc-a66c-4e92-a6a2-1d0f9b68595b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:11.111028 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9b61b8fc-a66c-4e92-a6a2-1d0f9b68595b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:11.117216 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9b61b8fc-a66c-4e92-a6a2-1d0f9b68595b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:11.117660 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9b61b8fc-a66c-4e92-a6a2-1d0f9b68595b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:11.118433 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9b61b8fc-a66c-4e92-a6a2-1d0f9b68595b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:11.118861 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9b61b8fc-a66c-4e92-a6a2-1d0f9b68595b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:11.196754 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d2929977-fc84-4fd1-b071-d922afc66c22 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:11.204005 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d2929977-fc84-4fd1-b071-d922afc66c22 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.153810 Dec 15 19:12:11.204579 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 662/1252] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:11 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:11.254956 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9b61b8fc-a66c-4e92-a6a2-1d0f9b68595b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:11.262307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9b61b8fc-a66c-4e92-a6a2-1d0f9b68595b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.156260 Dec 15 19:12:11.262866 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 591/1253] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:11 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:12.220893 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8fbbe24f-8013-43c7-bcf8-48362ea31543 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:12.221526 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8fbbe24f-8013-43c7-bcf8-48362ea31543 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:12.227790 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fbbe24f-8013-43c7-bcf8-48362ea31543 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:12.228238 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fbbe24f-8013-43c7-bcf8-48362ea31543 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:12.229043 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fbbe24f-8013-43c7-bcf8-48362ea31543 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:12.229504 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8fbbe24f-8013-43c7-bcf8-48362ea31543 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:12.279216 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-147eae5f-ceaa-4340-a27c-d212abe6006f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:12.279817 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-147eae5f-ceaa-4340-a27c-d212abe6006f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:12.286077 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-147eae5f-ceaa-4340-a27c-d212abe6006f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:12.290566 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-147eae5f-ceaa-4340-a27c-d212abe6006f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:12.290566 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-147eae5f-ceaa-4340-a27c-d212abe6006f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:12.290566 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-147eae5f-ceaa-4340-a27c-d212abe6006f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:12.359453 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8fbbe24f-8013-43c7-bcf8-48362ea31543 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:12.366992 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8fbbe24f-8013-43c7-bcf8-48362ea31543 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.150295 Dec 15 19:12:12.367692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 663/1254] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:12 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:12.420541 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-147eae5f-ceaa-4340-a27c-d212abe6006f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:12.427739 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-147eae5f-ceaa-4340-a27c-d212abe6006f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.152334 Dec 15 19:12:12.428294 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 592/1255] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:12 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:13.384969 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7448506b-b4ef-4757-bf27-338506ff5063 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:13.385623 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7448506b-b4ef-4757-bf27-338506ff5063 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:13.392846 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7448506b-b4ef-4757-bf27-338506ff5063 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:13.393446 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7448506b-b4ef-4757-bf27-338506ff5063 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:13.394238 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7448506b-b4ef-4757-bf27-338506ff5063 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:13.394735 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7448506b-b4ef-4757-bf27-338506ff5063 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:13.443875 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6f6574cb-cddb-407f-9fc3-ad71690657a3 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:13.445286 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6f6574cb-cddb-407f-9fc3-ad71690657a3 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:13.460222 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f6574cb-cddb-407f-9fc3-ad71690657a3 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:13.460712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f6574cb-cddb-407f-9fc3-ad71690657a3 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:13.461553 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f6574cb-cddb-407f-9fc3-ad71690657a3 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:13.461993 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6f6574cb-cddb-407f-9fc3-ad71690657a3 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:13.551878 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7448506b-b4ef-4757-bf27-338506ff5063 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:13.559208 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7448506b-b4ef-4757-bf27-338506ff5063 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.177958 Dec 15 19:12:13.559811 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 664/1256] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:13 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:13.605697 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-6f6574cb-cddb-407f-9fc3-ad71690657a3 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:13.613271 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6f6574cb-cddb-407f-9fc3-ad71690657a3 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.172994 Dec 15 19:12:13.616154 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 593/1257] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:13 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:14.575789 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b42dfb86-85af-43e3-85bf-77fe42cfa2e2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:14.576340 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b42dfb86-85af-43e3-85bf-77fe42cfa2e2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:14.582602 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b42dfb86-85af-43e3-85bf-77fe42cfa2e2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:14.592220 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b42dfb86-85af-43e3-85bf-77fe42cfa2e2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:14.592220 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b42dfb86-85af-43e3-85bf-77fe42cfa2e2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:14.592220 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b42dfb86-85af-43e3-85bf-77fe42cfa2e2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:14.629859 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-1d3796f4-ebed-4a4c-9b08-97a4390479ec tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:14.630469 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-1d3796f4-ebed-4a4c-9b08-97a4390479ec tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:14.636765 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1d3796f4-ebed-4a4c-9b08-97a4390479ec tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:14.646728 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1d3796f4-ebed-4a4c-9b08-97a4390479ec tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:14.646728 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1d3796f4-ebed-4a4c-9b08-97a4390479ec tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:14.646728 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-1d3796f4-ebed-4a4c-9b08-97a4390479ec tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:14.719422 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b42dfb86-85af-43e3-85bf-77fe42cfa2e2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:14.726569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b42dfb86-85af-43e3-85bf-77fe42cfa2e2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.154498 Dec 15 19:12:14.727151 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 665/1258] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:14 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:14.774614 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-1d3796f4-ebed-4a4c-9b08-97a4390479ec tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:14.782419 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-1d3796f4-ebed-4a4c-9b08-97a4390479ec tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.156240 Dec 15 19:12:14.782980 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 594/1259] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:14 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:15.308447 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-e00e5eb0-47c0-45ee-971a-0fdbb32fd911 req-08b3c0b4-0959-485f-9538-53ecae3db00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffb4aed-e9be-4716-a597-482f00777b32", "name": "network-vif-plugged", "status": "completed", "tag": "9f9d0581-f26f-4922-957e-adc9da3e70df"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:15.310024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:15.310024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:12:15.317268 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-e00e5eb0-47c0-45ee-971a-0fdbb32fd911 req-08b3c0b4-0959-485f-9538-53ecae3db00f service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:15.317692 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-e00e5eb0-47c0-45ee-971a-0fdbb32fd911 req-08b3c0b4-0959-485f-9538-53ecae3db00f service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:15.328773 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-e00e5eb0-47c0-45ee-971a-0fdbb32fd911 req-08b3c0b4-0959-485f-9538-53ecae3db00f service nova] Creating event network-vif-plugged:9f9d0581-f26f-4922-957e-adc9da3e70df for instance bffb4aed-e9be-4716-a597-482f00777b32 on hv-cinder-81268 Dec 15 19:12:15.333720 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-e00e5eb0-47c0-45ee-971a-0fdbb32fd911 req-08b3c0b4-0959-485f-9538-53ecae3db00f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028820 Dec 15 19:12:15.334539 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 666/1260] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:15.743537 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-55048ec0-5c3e-4e84-bf25-1b8ddab29c35 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:15.744158 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-55048ec0-5c3e-4e84-bf25-1b8ddab29c35 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:15.751246 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-55048ec0-5c3e-4e84-bf25-1b8ddab29c35 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:15.751692 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-55048ec0-5c3e-4e84-bf25-1b8ddab29c35 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:15.752470 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-55048ec0-5c3e-4e84-bf25-1b8ddab29c35 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:15.752907 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-55048ec0-5c3e-4e84-bf25-1b8ddab29c35 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:15.800460 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-9a28aceb-cad9-4c1f-a3c1-ad3050279539 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:15.807461 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-9a28aceb-cad9-4c1f-a3c1-ad3050279539 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:15.807461 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9a28aceb-cad9-4c1f-a3c1-ad3050279539 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:15.807712 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9a28aceb-cad9-4c1f-a3c1-ad3050279539 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:15.808408 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9a28aceb-cad9-4c1f-a3c1-ad3050279539 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:15.808838 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-9a28aceb-cad9-4c1f-a3c1-ad3050279539 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:15.883482 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-55048ec0-5c3e-4e84-bf25-1b8ddab29c35 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:15.890799 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-55048ec0-5c3e-4e84-bf25-1b8ddab29c35 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1313 microversion: 2.1 time: 0.150962 Dec 15 19:12:15.893433 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 595/1261] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:15 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:15.945273 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-9a28aceb-cad9-4c1f-a3c1-ad3050279539 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:15.952439 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-9a28aceb-cad9-4c1f-a3c1-ad3050279539 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.156938 Dec 15 19:12:15.952999 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 667/1262] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:15 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:16.907776 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-95054f44-22e9-4c5c-82dc-0372da4a2488 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:16.908892 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-95054f44-22e9-4c5c-82dc-0372da4a2488 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:16.915204 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-95054f44-22e9-4c5c-82dc-0372da4a2488 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:16.919792 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-95054f44-22e9-4c5c-82dc-0372da4a2488 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:16.919792 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-95054f44-22e9-4c5c-82dc-0372da4a2488 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:16.919792 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-95054f44-22e9-4c5c-82dc-0372da4a2488 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:16.969431 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-a7f45bca-6c26-4c82-b0a1-28acc34f1cfe tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:16.970049 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-a7f45bca-6c26-4c82-b0a1-28acc34f1cfe tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:16.976412 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a7f45bca-6c26-4c82-b0a1-28acc34f1cfe tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:16.977182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a7f45bca-6c26-4c82-b0a1-28acc34f1cfe tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:16.977886 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a7f45bca-6c26-4c82-b0a1-28acc34f1cfe tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:16.978325 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-a7f45bca-6c26-4c82-b0a1-28acc34f1cfe tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:17.048451 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-95054f44-22e9-4c5c-82dc-0372da4a2488 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:17.057287 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-95054f44-22e9-4c5c-82dc-0372da4a2488 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1496 microversion: 2.1 time: 0.152809 Dec 15 19:12:17.058335 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 596/1263] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:16 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1496 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:17.116285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-a7f45bca-6c26-4c82-b0a1-28acc34f1cfe tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:17.123664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-a7f45bca-6c26-4c82-b0a1-28acc34f1cfe tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.158074 Dec 15 19:12:17.124236 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 668/1264] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:16 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:17.873529 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-684cceca-a9fd-4314-afd6-ef3376f668ce tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:17.874027 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-684cceca-a9fd-4314-afd6-ef3376f668ce tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:17.879847 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-684cceca-a9fd-4314-afd6-ef3376f668ce tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:17.880325 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-684cceca-a9fd-4314-afd6-ef3376f668ce tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:17.881126 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-684cceca-a9fd-4314-afd6-ef3376f668ce tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:17.881570 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-684cceca-a9fd-4314-afd6-ef3376f668ce tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:17.905502 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-684cceca-a9fd-4314-afd6-ef3376f668ce tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:12:18.141542 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4e44a63e-210a-453d-85f7-e0c7fd602800 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:18.142139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4e44a63e-210a-453d-85f7-e0c7fd602800 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:18.148353 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4e44a63e-210a-453d-85f7-e0c7fd602800 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:18.148826 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4e44a63e-210a-453d-85f7-e0c7fd602800 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:18.149610 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4e44a63e-210a-453d-85f7-e0c7fd602800 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:18.154368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4e44a63e-210a-453d-85f7-e0c7fd602800 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:18.173565 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-684cceca-a9fd-4314-afd6-ef3376f668ce tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 204 len: 0 microversion: 2.1 time: 0.303238 Dec 15 19:12:18.174435 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 597/1265] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:12:17 2021] DELETE /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:12:18.182506 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-15ba6bce-4081-46dd-ac2a-3f9c142d2235 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:18.183256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-15ba6bce-4081-46dd-ac2a-3f9c142d2235 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:18.189173 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-15ba6bce-4081-46dd-ac2a-3f9c142d2235 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:18.189629 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-15ba6bce-4081-46dd-ac2a-3f9c142d2235 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:18.190411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-15ba6bce-4081-46dd-ac2a-3f9c142d2235 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:18.190848 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-15ba6bce-4081-46dd-ac2a-3f9c142d2235 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:18.287836 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4e44a63e-210a-453d-85f7-e0c7fd602800 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:18.295421 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4e44a63e-210a-453d-85f7-e0c7fd602800 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.158096 Dec 15 19:12:18.296043 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 669/1266] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:18 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:18.332178 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-15ba6bce-4081-46dd-ac2a-3f9c142d2235 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:18.339956 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-15ba6bce-4081-46dd-ac2a-3f9c142d2235 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1502 microversion: 2.1 time: 0.161325 Dec 15 19:12:18.340562 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 598/1267] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:18 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:19.311697 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-efb11f90-eafc-4de6-9789-24882f8ada17 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:19.312298 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-efb11f90-eafc-4de6-9789-24882f8ada17 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:19.318900 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-70f5bb7f-ce6d-461f-abda-4fdb4d32791d req-120a90a0-f40a-4bcc-97d6-0af0d3babf9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6128c912-1a49-4e44-add6-bcd197f85063", "name": "network-vif-plugged", "status": "completed", "tag": "1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:19.321257 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:19.321257 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:12:19.328318 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-efb11f90-eafc-4de6-9789-24882f8ada17 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:19.329103 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-efb11f90-eafc-4de6-9789-24882f8ada17 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:19.330123 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-efb11f90-eafc-4de6-9789-24882f8ada17 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:19.330770 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-efb11f90-eafc-4de6-9789-24882f8ada17 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:19.330886 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-70f5bb7f-ce6d-461f-abda-4fdb4d32791d req-120a90a0-f40a-4bcc-97d6-0af0d3babf9f service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:19.331298 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-70f5bb7f-ce6d-461f-abda-4fdb4d32791d req-120a90a0-f40a-4bcc-97d6-0af0d3babf9f service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:19.346552 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-70f5bb7f-ce6d-461f-abda-4fdb4d32791d req-120a90a0-f40a-4bcc-97d6-0af0d3babf9f service nova] Creating event network-vif-plugged:1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9 for instance 6128c912-1a49-4e44-add6-bcd197f85063 on hv-cinder-81268 Dec 15 19:12:19.348631 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-70f5bb7f-ce6d-461f-abda-4fdb4d32791d req-120a90a0-f40a-4bcc-97d6-0af0d3babf9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034854 Dec 15 19:12:19.349547 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 599/1268] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:19.358808 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-0b0c00bc-90aa-42a5-943b-1fc45dab1aa4 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:19.360124 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-0b0c00bc-90aa-42a5-943b-1fc45dab1aa4 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:19.367443 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b0c00bc-90aa-42a5-943b-1fc45dab1aa4 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:19.367898 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b0c00bc-90aa-42a5-943b-1fc45dab1aa4 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:19.368696 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b0c00bc-90aa-42a5-943b-1fc45dab1aa4 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:19.369156 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-0b0c00bc-90aa-42a5-943b-1fc45dab1aa4 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:19.510802 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-0b0c00bc-90aa-42a5-943b-1fc45dab1aa4 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:19.519047 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-0b0c00bc-90aa-42a5-943b-1fc45dab1aa4 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1502 microversion: 2.1 time: 0.164606 Dec 15 19:12:19.519880 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 600/1269] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:19 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:19.565889 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-efb11f90-eafc-4de6-9789-24882f8ada17 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:19.573255 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-efb11f90-eafc-4de6-9789-24882f8ada17 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.265229 Dec 15 19:12:19.581580 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 670/1270] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:19 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:20.145203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-209337d0-d438-47ed-8e9d-0d6eabcc385c req-ba7bdca6-6fc2-4320-ba2d-c6e5cacb0bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffb4aed-e9be-4716-a597-482f00777b32", "name": "network-vif-deleted", "tag": "9f9d0581-f26f-4922-957e-adc9da3e70df"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:20.145203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:20.145203 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:12:20.151655 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-209337d0-d438-47ed-8e9d-0d6eabcc385c req-ba7bdca6-6fc2-4320-ba2d-c6e5cacb0bca service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:20.152098 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-209337d0-d438-47ed-8e9d-0d6eabcc385c req-ba7bdca6-6fc2-4320-ba2d-c6e5cacb0bca service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:20.164311 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-209337d0-d438-47ed-8e9d-0d6eabcc385c req-ba7bdca6-6fc2-4320-ba2d-c6e5cacb0bca service nova] Creating event network-vif-deleted:9f9d0581-f26f-4922-957e-adc9da3e70df for instance bffb4aed-e9be-4716-a597-482f00777b32 on hv-cinder-81268 Dec 15 19:12:20.169376 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-209337d0-d438-47ed-8e9d-0d6eabcc385c req-ba7bdca6-6fc2-4320-ba2d-c6e5cacb0bca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031719 Dec 15 19:12:20.170417 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 601/1271] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:20.536220 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:20.536827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:20.543106 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:20.543554 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:20.544331 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:20.544763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:20.576139 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:20.576587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:20.577032 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lazy-loading 'fault' on Instance uuid bffb4aed-e9be-4716-a597-482f00777b32 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:12:20.591820 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ebe84129-1df1-44db-90cb-d02ce1bdc618 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:20.592687 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ebe84129-1df1-44db-90cb-d02ce1bdc618 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:20.599446 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebe84129-1df1-44db-90cb-d02ce1bdc618 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:20.599885 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebe84129-1df1-44db-90cb-d02ce1bdc618 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:20.600672 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebe84129-1df1-44db-90cb-d02ce1bdc618 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:20.601142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebe84129-1df1-44db-90cb-d02ce1bdc618 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:20.616534 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:20.623745 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-033eefb4-dc81-4997-a127-ec8f6a57abff tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 200 len: 1303 microversion: 2.1 time: 0.091326 Dec 15 19:12:20.624311 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 671/1272] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:20 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:20.737674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ebe84129-1df1-44db-90cb-d02ce1bdc618 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:20.745037 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ebe84129-1df1-44db-90cb-d02ce1bdc618 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1260 microversion: 2.1 time: 0.157668 Dec 15 19:12:20.749233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 602/1273] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:20 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:21.640602 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e2c86c3d-d406-4837-a08e-13f7f6d865e7 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:21.641140 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e2c86c3d-d406-4837-a08e-13f7f6d865e7 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: bffb4aed-e9be-4716-a597-482f00777b32] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:21.647379 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e2c86c3d-d406-4837-a08e-13f7f6d865e7 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:21.647819 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e2c86c3d-d406-4837-a08e-13f7f6d865e7 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:21.648587 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e2c86c3d-d406-4837-a08e-13f7f6d865e7 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:21.649017 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e2c86c3d-d406-4837-a08e-13f7f6d865e7 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:21.661856 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-e2c86c3d-d406-4837-a08e-13f7f6d865e7 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] HTTP exception thrown: Instance bffb4aed-e9be-4716-a597-482f00777b32 could not be found. Dec 15 19:12:21.662431 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e2c86c3d-d406-4837-a08e-13f7f6d865e7 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Returning 404 to user: Instance bffb4aed-e9be-4716-a597-482f00777b32 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:12:21.663221 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e2c86c3d-d406-4837-a08e-13f7f6d865e7 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32" status: 404 len: 111 microversion: 2.1 time: 0.026403 Dec 15 19:12:21.663734 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 672/1274] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:21 2021] GET /compute/v2.1/servers/bffb4aed-e9be-4716-a597-482f00777b32 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:12:21.762008 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-78a02e15-5796-4afd-a97f-8dbce4299c47 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:21.762620 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-78a02e15-5796-4afd-a97f-8dbce4299c47 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:21.766285 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2002250761", "imageRef": "bb9d5160-441f-4322-bd25-13a99cfe1d5c", "flavorRef": "452", "networks": [{"uuid": "c5253451-6588-47e6-8d09-495adf4b3ded"}]}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:21.769145 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78a02e15-5796-4afd-a97f-8dbce4299c47 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:21.769597 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78a02e15-5796-4afd-a97f-8dbce4299c47 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:21.770388 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78a02e15-5796-4afd-a97f-8dbce4299c47 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:21.770847 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-78a02e15-5796-4afd-a97f-8dbce4299c47 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:21.816839 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.network.neutron [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] validate_networks() for [('c5253451-6588-47e6-8d09-495adf4b3ded', None, None, None, None, None)] {{(pid=116514) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 19:12:21.905242 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-78a02e15-5796-4afd-a97f-8dbce4299c47 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:21.912713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-78a02e15-5796-4afd-a97f-8dbce4299c47 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1443 microversion: 2.1 time: 0.154487 Dec 15 19:12:21.914089 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 603/1275] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:21 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:21.932828 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3335738e-fe82-4707-b7b5-2c69b48af6f2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:21.933457 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3335738e-fe82-4707-b7b5-2c69b48af6f2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:21.940120 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3335738e-fe82-4707-b7b5-2c69b48af6f2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:21.940572 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3335738e-fe82-4707-b7b5-2c69b48af6f2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:21.941372 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3335738e-fe82-4707-b7b5-2c69b48af6f2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:21.941801 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3335738e-fe82-4707-b7b5-2c69b48af6f2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:22.075318 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3335738e-fe82-4707-b7b5-2c69b48af6f2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:22.083239 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3335738e-fe82-4707-b7b5-2c69b48af6f2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1443 microversion: 2.1 time: 0.153866 Dec 15 19:12:22.083782 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 604/1276] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:21 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:22.161024 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Flavor limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 19:12:22.161719 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Image limits 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 19:12:22.162195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Flavor pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 19:12:22.162601 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Image pref 0:0:0 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 19:12:22.163009 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.virt.hardware [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 19:12:22.172301 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:22.172789 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:22.173650 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:22.174131 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:22.190202 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Getting quotas for project 6d24ab04ab414e69844313a3ecc8e946. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 19:12:22.194166 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.quota [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Getting quotas for user 7d383e3982904d5a893c6eec056fe494 and project 6d24ab04ab414e69844313a3ecc8e946. Resources: {'instances', 'ram', 'cores'} {{(pid=116514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 19:12:22.204629 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Going to run 1 instances... {{(pid=116514) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 19:12:22.206980 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9d5160-441f-4322-bd25-13a99cfe1d5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 19:12:22.303704 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-929999e0-e348-48c7-a3a4-9c9a940fe084 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543694 Dec 15 19:12:22.304360 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 673/1277] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Dec 15 19:12:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 19:12:22.314455 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b9fd63a3-19bf-48d6-92ad-3d7c638cd428 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:22.315155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b9fd63a3-19bf-48d6-92ad-3d7c638cd428 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:22.370633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b9fd63a3-19bf-48d6-92ad-3d7c638cd428 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:22.376978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b9fd63a3-19bf-48d6-92ad-3d7c638cd428 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1214 microversion: 2.1 time: 0.066195 Dec 15 19:12:22.377966 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 605/1278] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:22 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:23.394698 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8a33e8b1-0bff-4125-86b9-251e08353fc9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:23.395305 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8a33e8b1-0bff-4125-86b9-251e08353fc9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:23.401509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8a33e8b1-0bff-4125-86b9-251e08353fc9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:23.401954 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8a33e8b1-0bff-4125-86b9-251e08353fc9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:23.402723 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8a33e8b1-0bff-4125-86b9-251e08353fc9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:23.403151 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8a33e8b1-0bff-4125-86b9-251e08353fc9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:23.462824 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8a33e8b1-0bff-4125-86b9-251e08353fc9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:23.470937 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8a33e8b1-0bff-4125-86b9-251e08353fc9 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1218 microversion: 2.1 time: 0.080584 Dec 15 19:12:23.480248 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 674/1279] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:23 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:24.451767 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-80c615f6-0fd8-448a-affd-9540a6a15fe2 req-48716c53-cd6d-458f-b420-8093b4924c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6128c912-1a49-4e44-add6-bcd197f85063", "tag": "1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:24.454291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:24.454291 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:12:24.462713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-80c615f6-0fd8-448a-affd-9540a6a15fe2 req-48716c53-cd6d-458f-b420-8093b4924c83 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:24.463233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-80c615f6-0fd8-448a-affd-9540a6a15fe2 req-48716c53-cd6d-458f-b420-8093b4924c83 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:24.473383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-80c615f6-0fd8-448a-affd-9540a6a15fe2 req-48716c53-cd6d-458f-b420-8093b4924c83 service nova] Creating event network-changed:1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9 for instance 6128c912-1a49-4e44-add6-bcd197f85063 on hv-cinder-81268 Dec 15 19:12:24.478361 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-80c615f6-0fd8-448a-affd-9540a6a15fe2 req-48716c53-cd6d-458f-b420-8093b4924c83 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030354 Dec 15 19:12:24.479279 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 606/1280] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:24.487793 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-fc18792b-3b6d-4ffd-a4b0-b095b99b1299 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:24.488961 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-fc18792b-3b6d-4ffd-a4b0-b095b99b1299 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:24.496390 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fc18792b-3b6d-4ffd-a4b0-b095b99b1299 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:24.496835 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fc18792b-3b6d-4ffd-a4b0-b095b99b1299 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:24.497660 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fc18792b-3b6d-4ffd-a4b0-b095b99b1299 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:24.498087 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-fc18792b-3b6d-4ffd-a4b0-b095b99b1299 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:24.872703 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-fc18792b-3b6d-4ffd-a4b0-b095b99b1299 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:24.881669 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-fc18792b-3b6d-4ffd-a4b0-b095b99b1299 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1284 microversion: 2.1 time: 0.397720 Dec 15 19:12:24.884044 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 675/1281] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:24 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1284 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:25.900578 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-54621328-91cb-493a-bc7a-4d26cabdf1ac tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:25.901300 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-54621328-91cb-493a-bc7a-4d26cabdf1ac tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:25.908266 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-54621328-91cb-493a-bc7a-4d26cabdf1ac tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:25.908764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-54621328-91cb-493a-bc7a-4d26cabdf1ac tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:25.909571 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-54621328-91cb-493a-bc7a-4d26cabdf1ac tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:25.910003 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-54621328-91cb-493a-bc7a-4d26cabdf1ac tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:26.040354 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-54621328-91cb-493a-bc7a-4d26cabdf1ac tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:26.048259 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-54621328-91cb-493a-bc7a-4d26cabdf1ac tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1314 microversion: 2.1 time: 0.152262 Dec 15 19:12:26.048833 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 607/1282] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:25 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:26.098536 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-fda9a257-4d61-4bad-af16-e05df8f0f9d9 req-a16c8858-5092-42ce-ac0f-63265f88f7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c562530-2c8e-4eea-b84d-413b9fc9296f", "tag": "c95572dc-502b-4d4e-8182-5d2d5e9bd056"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:26.100122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:26.100122 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:12:26.107569 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-fda9a257-4d61-4bad-af16-e05df8f0f9d9 req-a16c8858-5092-42ce-ac0f-63265f88f7b4 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:26.108013 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-fda9a257-4d61-4bad-af16-e05df8f0f9d9 req-a16c8858-5092-42ce-ac0f-63265f88f7b4 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:26.120054 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-fda9a257-4d61-4bad-af16-e05df8f0f9d9 req-a16c8858-5092-42ce-ac0f-63265f88f7b4 service nova] Creating event network-changed:c95572dc-502b-4d4e-8182-5d2d5e9bd056 for instance 0c562530-2c8e-4eea-b84d-413b9fc9296f on hv-cinder-81268 Dec 15 19:12:26.124557 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-fda9a257-4d61-4bad-af16-e05df8f0f9d9 req-a16c8858-5092-42ce-ac0f-63265f88f7b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029922 Dec 15 19:12:26.125187 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 676/1283] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:27.066338 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5e90fb26-3c46-416a-86a7-27b23e6e23b3 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:27.066867 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5e90fb26-3c46-416a-86a7-27b23e6e23b3 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:27.073074 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e90fb26-3c46-416a-86a7-27b23e6e23b3 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:27.073492 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e90fb26-3c46-416a-86a7-27b23e6e23b3 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:27.074256 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e90fb26-3c46-416a-86a7-27b23e6e23b3 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:27.074686 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5e90fb26-3c46-416a-86a7-27b23e6e23b3 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:27.200855 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5e90fb26-3c46-416a-86a7-27b23e6e23b3 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:27.208003 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5e90fb26-3c46-416a-86a7-27b23e6e23b3 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1314 microversion: 2.1 time: 0.146064 Dec 15 19:12:27.208598 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 608/1284] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:27 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:28.225605 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-afa5311f-3fec-4714-904c-dcf57cf15d20 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:28.226312 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-afa5311f-3fec-4714-904c-dcf57cf15d20 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:28.232769 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afa5311f-3fec-4714-904c-dcf57cf15d20 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:28.233264 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afa5311f-3fec-4714-904c-dcf57cf15d20 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:28.234328 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afa5311f-3fec-4714-904c-dcf57cf15d20 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:28.235335 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-afa5311f-3fec-4714-904c-dcf57cf15d20 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:28.364827 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-afa5311f-3fec-4714-904c-dcf57cf15d20 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:28.372046 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-afa5311f-3fec-4714-904c-dcf57cf15d20 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1314 microversion: 2.1 time: 0.150440 Dec 15 19:12:28.372612 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 677/1285] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:28 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:29.387405 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-5c92dde5-898d-4ff6-8ba8-60fb769fb7a1 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:29.389419 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-5c92dde5-898d-4ff6-8ba8-60fb769fb7a1 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:29.394019 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5c92dde5-898d-4ff6-8ba8-60fb769fb7a1 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:29.394468 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5c92dde5-898d-4ff6-8ba8-60fb769fb7a1 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:29.395243 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5c92dde5-898d-4ff6-8ba8-60fb769fb7a1 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:29.395675 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-5c92dde5-898d-4ff6-8ba8-60fb769fb7a1 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:29.532394 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-5c92dde5-898d-4ff6-8ba8-60fb769fb7a1 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:29.539777 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-5c92dde5-898d-4ff6-8ba8-60fb769fb7a1 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1314 microversion: 2.1 time: 0.156041 Dec 15 19:12:29.540354 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 609/1286] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:29 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:30.556880 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-0e50bf6f-b3c2-44c8-8363-d67acf65a037 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:30.557521 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-0e50bf6f-b3c2-44c8-8363-d67acf65a037 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:30.564286 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0e50bf6f-b3c2-44c8-8363-d67acf65a037 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:30.564733 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0e50bf6f-b3c2-44c8-8363-d67acf65a037 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:30.565536 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0e50bf6f-b3c2-44c8-8363-d67acf65a037 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:30.565975 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-0e50bf6f-b3c2-44c8-8363-d67acf65a037 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:30.694464 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-0e50bf6f-b3c2-44c8-8363-d67acf65a037 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:30.701730 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-0e50bf6f-b3c2-44c8-8363-d67acf65a037 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1314 microversion: 2.1 time: 0.148571 Dec 15 19:12:30.702294 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 678/1287] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:30 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:31.440444 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-b1f36c53-5fe4-4297-9157-be681e1488f2 req-9f18cc37-b2c2-4369-a962-57aa2d992168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c562530-2c8e-4eea-b84d-413b9fc9296f", "name": "network-vif-plugged", "status": "completed", "tag": "c95572dc-502b-4d4e-8182-5d2d5e9bd056"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:31.441988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:31.441988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:12:31.449048 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-b1f36c53-5fe4-4297-9157-be681e1488f2 req-9f18cc37-b2c2-4369-a962-57aa2d992168 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:31.449535 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-b1f36c53-5fe4-4297-9157-be681e1488f2 req-9f18cc37-b2c2-4369-a962-57aa2d992168 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:31.460338 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-b1f36c53-5fe4-4297-9157-be681e1488f2 req-9f18cc37-b2c2-4369-a962-57aa2d992168 service nova] Creating event network-vif-plugged:c95572dc-502b-4d4e-8182-5d2d5e9bd056 for instance 0c562530-2c8e-4eea-b84d-413b9fc9296f on hv-cinder-81268 Dec 15 19:12:31.465190 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-b1f36c53-5fe4-4297-9157-be681e1488f2 req-9f18cc37-b2c2-4369-a962-57aa2d992168 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028304 Dec 15 19:12:31.465777 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 610/1288] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:31.718143 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e58d8603-30be-405d-921f-63ae6634ae03 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:31.718771 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e58d8603-30be-405d-921f-63ae6634ae03 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:31.725001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e58d8603-30be-405d-921f-63ae6634ae03 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:31.725478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e58d8603-30be-405d-921f-63ae6634ae03 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:31.726253 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e58d8603-30be-405d-921f-63ae6634ae03 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:31.726688 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e58d8603-30be-405d-921f-63ae6634ae03 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:31.893723 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-e58d8603-30be-405d-921f-63ae6634ae03 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:31.900842 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e58d8603-30be-405d-921f-63ae6634ae03 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1314 microversion: 2.1 time: 0.186464 Dec 15 19:12:31.901445 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 679/1289] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:31 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:32.917544 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3f0a596f-dd5c-4677-a9d7-3c6376269e52 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:32.918172 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3f0a596f-dd5c-4677-a9d7-3c6376269e52 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:32.925145 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f0a596f-dd5c-4677-a9d7-3c6376269e52 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:32.925603 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f0a596f-dd5c-4677-a9d7-3c6376269e52 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:32.926386 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f0a596f-dd5c-4677-a9d7-3c6376269e52 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:32.926874 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f0a596f-dd5c-4677-a9d7-3c6376269e52 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:33.054534 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3f0a596f-dd5c-4677-a9d7-3c6376269e52 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:33.061609 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3f0a596f-dd5c-4677-a9d7-3c6376269e52 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1314 microversion: 2.1 time: 0.148611 Dec 15 19:12:33.062168 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 611/1290] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:32 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:34.078686 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b7422240-311c-4bb7-8305-72503e1e7f26 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:34.079940 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b7422240-311c-4bb7-8305-72503e1e7f26 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:34.086274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7422240-311c-4bb7-8305-72503e1e7f26 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:34.086724 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7422240-311c-4bb7-8305-72503e1e7f26 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:34.087500 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7422240-311c-4bb7-8305-72503e1e7f26 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:34.087967 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b7422240-311c-4bb7-8305-72503e1e7f26 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:34.217868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b7422240-311c-4bb7-8305-72503e1e7f26 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:34.225003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b7422240-311c-4bb7-8305-72503e1e7f26 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1498 microversion: 2.1 time: 0.149987 Dec 15 19:12:34.225589 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 680/1291] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:34 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:12:35.044260 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-6cac1627-2f78-420b-8ba3-c8c2a4de9762 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:35.044822 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6cac1627-2f78-420b-8ba3-c8c2a4de9762 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:35.051768 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6cac1627-2f78-420b-8ba3-c8c2a4de9762 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:35.052213 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6cac1627-2f78-420b-8ba3-c8c2a4de9762 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:35.052986 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6cac1627-2f78-420b-8ba3-c8c2a4de9762 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:35.053456 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-6cac1627-2f78-420b-8ba3-c8c2a4de9762 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:35.076973 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-6cac1627-2f78-420b-8ba3-c8c2a4de9762 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:12:35.403526 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-6cac1627-2f78-420b-8ba3-c8c2a4de9762 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 204 len: 0 microversion: 2.1 time: 0.362611 Dec 15 19:12:35.404275 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 612/1292] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:12:35 2021] DELETE /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:12:35.413002 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-ecf5f3f9-5ee2-48e6-bc3c-30e718b577b2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:35.413663 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-ecf5f3f9-5ee2-48e6-bc3c-30e718b577b2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:35.420121 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecf5f3f9-5ee2-48e6-bc3c-30e718b577b2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:35.420574 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecf5f3f9-5ee2-48e6-bc3c-30e718b577b2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:35.421408 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecf5f3f9-5ee2-48e6-bc3c-30e718b577b2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:35.421853 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-ecf5f3f9-5ee2-48e6-bc3c-30e718b577b2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:35.566076 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-ecf5f3f9-5ee2-48e6-bc3c-30e718b577b2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:35.573273 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-ecf5f3f9-5ee2-48e6-bc3c-30e718b577b2 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1504 microversion: 2.1 time: 0.164090 Dec 15 19:12:35.573849 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 681/1293] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:35 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:36.592092 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f94acbbb-cd02-43d7-9c06-4eab2e304703 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:36.592713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f94acbbb-cd02-43d7-9c06-4eab2e304703 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:36.599767 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f94acbbb-cd02-43d7-9c06-4eab2e304703 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:36.600229 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f94acbbb-cd02-43d7-9c06-4eab2e304703 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:36.601011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f94acbbb-cd02-43d7-9c06-4eab2e304703 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:36.601479 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f94acbbb-cd02-43d7-9c06-4eab2e304703 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:36.736591 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-f94acbbb-cd02-43d7-9c06-4eab2e304703 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:36.743796 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f94acbbb-cd02-43d7-9c06-4eab2e304703 tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1504 microversion: 2.1 time: 0.155847 Dec 15 19:12:36.744356 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 613/1294] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:36 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:37.578534 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-d2afa5ec-6379-4e8c-850f-2e4dd4f3e508 req-f881839e-89da-44ba-9c2a-f7c2d9ce8b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c562530-2c8e-4eea-b84d-413b9fc9296f", "name": "network-vif-deleted", "tag": "c95572dc-502b-4d4e-8182-5d2d5e9bd056"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:12:37.580029 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:12:37.580029 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:12:37.587275 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-d2afa5ec-6379-4e8c-850f-2e4dd4f3e508 req-f881839e-89da-44ba-9c2a-f7c2d9ce8b18 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:37.587723 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-d2afa5ec-6379-4e8c-850f-2e4dd4f3e508 req-f881839e-89da-44ba-9c2a-f7c2d9ce8b18 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:37.598509 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-d2afa5ec-6379-4e8c-850f-2e4dd4f3e508 req-f881839e-89da-44ba-9c2a-f7c2d9ce8b18 service nova] Creating event network-vif-deleted:c95572dc-502b-4d4e-8182-5d2d5e9bd056 for instance 0c562530-2c8e-4eea-b84d-413b9fc9296f on hv-cinder-81268 Dec 15 19:12:37.603478 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-d2afa5ec-6379-4e8c-850f-2e4dd4f3e508 req-f881839e-89da-44ba-9c2a-f7c2d9ce8b18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028663 Dec 15 19:12:37.604134 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 682/1295] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:12:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:12:37.759575 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-79415814-c9b2-4f2d-bfa6-a5eff13bdb6f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:37.760215 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-79415814-c9b2-4f2d-bfa6-a5eff13bdb6f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:37.767227 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-79415814-c9b2-4f2d-bfa6-a5eff13bdb6f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:37.767674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-79415814-c9b2-4f2d-bfa6-a5eff13bdb6f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:37.768450 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-79415814-c9b2-4f2d-bfa6-a5eff13bdb6f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:37.768881 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-79415814-c9b2-4f2d-bfa6-a5eff13bdb6f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:37.837508 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-79415814-c9b2-4f2d-bfa6-a5eff13bdb6f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d383e3982904d5a893c6eec056fe494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d24ab04ab414e69844313a3ecc8e946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:12:37.846093 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-79415814-c9b2-4f2d-bfa6-a5eff13bdb6f tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 200 len: 1299 microversion: 2.1 time: 0.090194 Dec 15 19:12:37.846777 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 614/1296] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:37 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:12:38.863746 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-766fe048-d2b5-47ea-a7e7-9c318e43c8aa tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:12:38.864434 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-766fe048-d2b5-47ea-a7e7-9c318e43c8aa tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] [instance: 0c562530-2c8e-4eea-b84d-413b9fc9296f] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:12:38.870502 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-766fe048-d2b5-47ea-a7e7-9c318e43c8aa tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:38.870950 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-766fe048-d2b5-47ea-a7e7-9c318e43c8aa tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:38.871719 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-766fe048-d2b5-47ea-a7e7-9c318e43c8aa tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:12:38.872152 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-766fe048-d2b5-47ea-a7e7-9c318e43c8aa tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:12:38.885418 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-766fe048-d2b5-47ea-a7e7-9c318e43c8aa tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] HTTP exception thrown: Instance 0c562530-2c8e-4eea-b84d-413b9fc9296f could not be found. Dec 15 19:12:38.885993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-766fe048-d2b5-47ea-a7e7-9c318e43c8aa tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] Returning 404 to user: Instance 0c562530-2c8e-4eea-b84d-413b9fc9296f could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:12:38.886792 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-766fe048-d2b5-47ea-a7e7-9c318e43c8aa tempest-VolumesActionsTest-1680608796 tempest-VolumesActionsTest-1680608796-project] 10.222.0.49 "GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f" status: 404 len: 111 microversion: 2.1 time: 0.028327 Dec 15 19:12:38.887321 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 683/1297] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:12:38 2021] GET /compute/v2.1/servers/0c562530-2c8e-4eea-b84d-413b9fc9296f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:13:19.058155 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:13:19.058795 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: Wed Dec 15 19:13:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:13:40.191340 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:13:40.191902 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: Wed Dec 15 19:13:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:13:48.420524 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-c0cafcfb-f070-4020-917d-9cd0c2e1c2b1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:48.421205 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c0cafcfb-f070-4020-917d-9cd0c2e1c2b1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:48.422677 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-df4e4681-77e7-4f2a-9e36-9b426047d60e req-39a156bd-e084-4a06-bad4-9cd1f8cd70a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70", "tag": "566463b4-e92a-40bf-9b9c-1e3562f26fbf"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:13:48.424290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:13:48.424290 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:13:48.427246 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0cafcfb-f070-4020-917d-9cd0c2e1c2b1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:48.427694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0cafcfb-f070-4020-917d-9cd0c2e1c2b1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:48.428476 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0cafcfb-f070-4020-917d-9cd0c2e1c2b1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:48.428905 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-c0cafcfb-f070-4020-917d-9cd0c2e1c2b1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:48.432011 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-df4e4681-77e7-4f2a-9e36-9b426047d60e req-39a156bd-e084-4a06-bad4-9cd1f8cd70a5 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:48.432589 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-df4e4681-77e7-4f2a-9e36-9b426047d60e req-39a156bd-e084-4a06-bad4-9cd1f8cd70a5 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:48.443749 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-df4e4681-77e7-4f2a-9e36-9b426047d60e req-39a156bd-e084-4a06-bad4-9cd1f8cd70a5 service nova] Creating event network-changed:566463b4-e92a-40bf-9b9c-1e3562f26fbf for instance e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 on hv-cinder-81268 Dec 15 19:13:48.449540 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-df4e4681-77e7-4f2a-9e36-9b426047d60e req-39a156bd-e084-4a06-bad4-9cd1f8cd70a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031712 Dec 15 19:13:48.450584 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 684/1298] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:13:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:13:48.456139 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-c0cafcfb-f070-4020-917d-9cd0c2e1c2b1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:13:48.782283 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-c0cafcfb-f070-4020-917d-9cd0c2e1c2b1 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 204 len: 0 microversion: 2.1 time: 0.365946 Dec 15 19:13:48.783019 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 615/1299] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:13:48 2021] DELETE /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:13:48.797497 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-72ffc18f-1316-4281-a800-26603cc25afb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:48.798195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-72ffc18f-1316-4281-a800-26603cc25afb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:48.804424 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72ffc18f-1316-4281-a800-26603cc25afb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:48.804873 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72ffc18f-1316-4281-a800-26603cc25afb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:48.805748 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72ffc18f-1316-4281-a800-26603cc25afb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:48.806182 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-72ffc18f-1316-4281-a800-26603cc25afb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:49.114622 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-72ffc18f-1316-4281-a800-26603cc25afb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:13:49.122816 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-72ffc18f-1316-4281-a800-26603cc25afb tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1574 microversion: 2.1 time: 0.329430 Dec 15 19:13:49.123394 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 685/1300] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:13:48 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1574 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:13:50.141355 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-644c5b83-40e4-41f1-add4-04289b09ce1f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:50.142056 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-644c5b83-40e4-41f1-add4-04289b09ce1f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:50.148910 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-644c5b83-40e4-41f1-add4-04289b09ce1f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:50.149382 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-644c5b83-40e4-41f1-add4-04289b09ce1f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:50.150166 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-644c5b83-40e4-41f1-add4-04289b09ce1f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:50.150606 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-644c5b83-40e4-41f1-add4-04289b09ce1f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:50.336588 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-644c5b83-40e4-41f1-add4-04289b09ce1f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:13:50.343924 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-644c5b83-40e4-41f1-add4-04289b09ce1f tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1455 microversion: 2.1 time: 0.206652 Dec 15 19:13:50.344477 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 616/1301] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:13:50 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1455 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:13:50.873665 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-e4b5a11e-3a9e-4f8b-9792-163167bc9d12 req-19588853-2e6d-44d4-b3f1-217a9b4a1270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70", "name": "network-vif-deleted", "tag": "566463b4-e92a-40bf-9b9c-1e3562f26fbf"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:13:50.875145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:13:50.875145 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:13:50.883144 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-e4b5a11e-3a9e-4f8b-9792-163167bc9d12 req-19588853-2e6d-44d4-b3f1-217a9b4a1270 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:50.885762 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-e4b5a11e-3a9e-4f8b-9792-163167bc9d12 req-19588853-2e6d-44d4-b3f1-217a9b4a1270 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:50.894027 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-e4b5a11e-3a9e-4f8b-9792-163167bc9d12 req-19588853-2e6d-44d4-b3f1-217a9b4a1270 service nova] Creating event network-vif-deleted:566463b4-e92a-40bf-9b9c-1e3562f26fbf for instance e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 on hv-cinder-81268 Dec 15 19:13:50.898766 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-e4b5a11e-3a9e-4f8b-9792-163167bc9d12 req-19588853-2e6d-44d4-b3f1-217a9b4a1270 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028756 Dec 15 19:13:50.899332 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 686/1302] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:13:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:13:51.360958 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:51.361632 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:51.368161 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:51.368562 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:51.369362 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:51.369798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:51.401990 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:51.402531 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:51.402981 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lazy-loading 'fault' on Instance uuid e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:13:51.441978 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:13:51.449312 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3f21b508-b1f1-4a94-b7ea-504d96d21a6a tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 200 len: 1229 microversion: 2.1 time: 0.091936 Dec 15 19:13:51.449865 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 617/1303] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:13:51 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:13:52.467775 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7d966c41-3188-40d5-a044-cca4691faeb6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:52.468538 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7d966c41-3188-40d5-a044-cca4691faeb6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:52.475152 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d966c41-3188-40d5-a044-cca4691faeb6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:52.475605 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d966c41-3188-40d5-a044-cca4691faeb6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:52.476389 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d966c41-3188-40d5-a044-cca4691faeb6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:52.476825 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7d966c41-3188-40d5-a044-cca4691faeb6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:52.490388 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-7d966c41-3188-40d5-a044-cca4691faeb6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] HTTP exception thrown: Instance e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 could not be found. Dec 15 19:13:52.490963 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7d966c41-3188-40d5-a044-cca4691faeb6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Returning 404 to user: Instance e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:13:52.491767 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7d966c41-3188-40d5-a044-cca4691faeb6 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70" status: 404 len: 111 microversion: 2.1 time: 0.028528 Dec 15 19:13:52.492284 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 687/1304] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:13:52 2021] GET /compute/v2.1/servers/e92b5b5f-e9fd-460a-8d5e-1052dc1e8f70 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:13:55.817857 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-f59d86f4-1f28-4d7a-bc18-66a317ed9d22 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:55.818389 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f59d86f4-1f28-4d7a-bc18-66a317ed9d22 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:55.820363 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-60b228aa-80e3-4de1-8d33-904e3d59ebe0 req-ba4f9599-b8b3-46aa-8282-9bcd9a69d6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dc52f2-0172-444c-a81e-114b83f31ae5", "tag": "9aff0ec1-39e4-4928-bb44-ff2c56b1c255"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:13:55.822693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:13:55.822693 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:13:55.825363 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f59d86f4-1f28-4d7a-bc18-66a317ed9d22 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:55.825826 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f59d86f4-1f28-4d7a-bc18-66a317ed9d22 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:55.826637 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f59d86f4-1f28-4d7a-bc18-66a317ed9d22 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:55.827075 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-f59d86f4-1f28-4d7a-bc18-66a317ed9d22 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:55.831101 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-60b228aa-80e3-4de1-8d33-904e3d59ebe0 req-ba4f9599-b8b3-46aa-8282-9bcd9a69d6a0 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:55.831665 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-60b228aa-80e3-4de1-8d33-904e3d59ebe0 req-ba4f9599-b8b3-46aa-8282-9bcd9a69d6a0 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:55.844487 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-60b228aa-80e3-4de1-8d33-904e3d59ebe0 req-ba4f9599-b8b3-46aa-8282-9bcd9a69d6a0 service nova] Creating event network-changed:9aff0ec1-39e4-4928-bb44-ff2c56b1c255 for instance 74dc52f2-0172-444c-a81e-114b83f31ae5 on hv-cinder-81268 Dec 15 19:13:55.850457 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-60b228aa-80e3-4de1-8d33-904e3d59ebe0 req-ba4f9599-b8b3-46aa-8282-9bcd9a69d6a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033842 Dec 15 19:13:55.851345 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 688/1305] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:13:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:13:55.857344 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-f59d86f4-1f28-4d7a-bc18-66a317ed9d22 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Going to try to terminate instance {{(pid=116515) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:13:56.190032 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-f59d86f4-1f28-4d7a-bc18-66a317ed9d22 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "DELETE /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 204 len: 0 microversion: 2.1 time: 0.375883 Dec 15 19:13:56.191155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 618/1306] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:13:55 2021] DELETE /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:13:56.199949 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-54fb0d65-ac69-4916-806a-5c1dd0b3e848 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:56.200958 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-54fb0d65-ac69-4916-806a-5c1dd0b3e848 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:56.207221 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-54fb0d65-ac69-4916-806a-5c1dd0b3e848 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:56.209220 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-54fb0d65-ac69-4916-806a-5c1dd0b3e848 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:56.209220 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-54fb0d65-ac69-4916-806a-5c1dd0b3e848 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:56.209650 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-54fb0d65-ac69-4916-806a-5c1dd0b3e848 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:56.680125 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-54fb0d65-ac69-4916-806a-5c1dd0b3e848 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:13:56.687883 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-54fb0d65-ac69-4916-806a-5c1dd0b3e848 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1574 microversion: 2.1 time: 0.491959 Dec 15 19:13:56.688468 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 689/1307] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:13:56 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1574 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:13:57.706522 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-8ae92b3f-e6c2-4b2a-b1c1-0b73f6bea4cf tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:57.707142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-8ae92b3f-e6c2-4b2a-b1c1-0b73f6bea4cf tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:57.714097 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8ae92b3f-e6c2-4b2a-b1c1-0b73f6bea4cf tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:57.714549 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8ae92b3f-e6c2-4b2a-b1c1-0b73f6bea4cf tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:57.715338 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8ae92b3f-e6c2-4b2a-b1c1-0b73f6bea4cf tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:57.715764 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-8ae92b3f-e6c2-4b2a-b1c1-0b73f6bea4cf tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:57.851980 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-8ae92b3f-e6c2-4b2a-b1c1-0b73f6bea4cf tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:13:57.859932 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-8ae92b3f-e6c2-4b2a-b1c1-0b73f6bea4cf tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1455 microversion: 2.1 time: 0.157530 Dec 15 19:13:57.860500 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 619/1308] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:13:57 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:13:58.215033 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-088678c7-2b1e-4e46-91ff-4a5bed9f6a5f req-d25aff97-17e6-4b48-a276-f1958c70a2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dc52f2-0172-444c-a81e-114b83f31ae5", "name": "network-vif-deleted", "tag": "9aff0ec1-39e4-4928-bb44-ff2c56b1c255"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:13:58.216590 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:13:58.216590 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:13:58.223747 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-088678c7-2b1e-4e46-91ff-4a5bed9f6a5f req-d25aff97-17e6-4b48-a276-f1958c70a2ad service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:58.224192 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-088678c7-2b1e-4e46-91ff-4a5bed9f6a5f req-d25aff97-17e6-4b48-a276-f1958c70a2ad service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:58.234974 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.compute.server_external_events [req-088678c7-2b1e-4e46-91ff-4a5bed9f6a5f req-d25aff97-17e6-4b48-a276-f1958c70a2ad service nova] Creating event network-vif-deleted:9aff0ec1-39e4-4928-bb44-ff2c56b1c255 for instance 74dc52f2-0172-444c-a81e-114b83f31ae5 on hv-cinder-81268 Dec 15 19:13:58.240148 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-088678c7-2b1e-4e46-91ff-4a5bed9f6a5f req-d25aff97-17e6-4b48-a276-f1958c70a2ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028778 Dec 15 19:13:58.240718 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 690/1309] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:13:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:13:58.877019 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:58.877671 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:58.884001 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:58.884455 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:58.885286 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:58.885728 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:58.915563 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:58.916011 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:58.916457 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.objects.instance [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lazy-loading 'fault' on Instance uuid 74dc52f2-0172-444c-a81e-114b83f31ae5 {{(pid=116515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:13:58.953798 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c21b8f3da14074949d2f6ba58b7204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f117be2c3e5e4d548c414fd1e198c1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:13:58.961674 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b76c0a51-a1c0-40c9-b06e-17bad1fbd5e5 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 200 len: 1229 microversion: 2.1 time: 0.088368 Dec 15 19:13:58.962417 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 620/1310] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:13:58 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:13:59.979855 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e3de8253-04b0-4b1d-bed3-7b0fa1f5497c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:13:59.980548 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-e3de8253-04b0-4b1d-bed3-7b0fa1f5497c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 74dc52f2-0172-444c-a81e-114b83f31ae5] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:13:59.986638 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e3de8253-04b0-4b1d-bed3-7b0fa1f5497c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:59.987084 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e3de8253-04b0-4b1d-bed3-7b0fa1f5497c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:13:59.987850 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e3de8253-04b0-4b1d-bed3-7b0fa1f5497c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:13:59.988282 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-e3de8253-04b0-4b1d-bed3-7b0fa1f5497c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:00.001806 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-e3de8253-04b0-4b1d-bed3-7b0fa1f5497c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] HTTP exception thrown: Instance 74dc52f2-0172-444c-a81e-114b83f31ae5 could not be found. Dec 15 19:14:00.002388 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-e3de8253-04b0-4b1d-bed3-7b0fa1f5497c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Returning 404 to user: Instance 74dc52f2-0172-444c-a81e-114b83f31ae5 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:14:00.003197 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-e3de8253-04b0-4b1d-bed3-7b0fa1f5497c tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5" status: 404 len: 111 microversion: 2.1 time: 0.028143 Dec 15 19:14:00.003725 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 691/1311] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:13:59 2021] GET /compute/v2.1/servers/74dc52f2-0172-444c-a81e-114b83f31ae5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:14:00.515808 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e68c8612-b6e4-4c5c-a0fd-93e520648421 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:00.516307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-e68c8612-b6e4-4c5c-a0fd-93e520648421 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:00.522712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e68c8612-b6e4-4c5c-a0fd-93e520648421 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:00.523159 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e68c8612-b6e4-4c5c-a0fd-93e520648421 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:00.523938 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e68c8612-b6e4-4c5c-a0fd-93e520648421 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:00.524369 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-e68c8612-b6e4-4c5c-a0fd-93e520648421 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:00.539382 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-e68c8612-b6e4-4c5c-a0fd-93e520648421 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] HTTP exception thrown: Instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 could not be found. Dec 15 19:14:00.539964 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-e68c8612-b6e4-4c5c-a0fd-93e520648421 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Returning 404 to user: Instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:14:00.540802 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-e68c8612-b6e4-4c5c-a0fd-93e520648421 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "DELETE /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 404 len: 111 microversion: 2.1 time: 0.029030 Dec 15 19:14:00.541358 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 621/1312] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:14:00 2021] DELETE /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:14:00.554946 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6bbc9e0d-295b-4f87-be4d-b9f1c79b89b0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:00.555818 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6bbc9e0d-295b-4f87-be4d-b9f1c79b89b0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] [instance: 688fbf24-7c98-4e51-8d6d-3a9f84044719] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:00.561695 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6bbc9e0d-295b-4f87-be4d-b9f1c79b89b0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:00.562161 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6bbc9e0d-295b-4f87-be4d-b9f1c79b89b0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:00.562904 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6bbc9e0d-295b-4f87-be4d-b9f1c79b89b0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:00.563333 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6bbc9e0d-295b-4f87-be4d-b9f1c79b89b0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:00.576630 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.wsgi [None req-6bbc9e0d-295b-4f87-be4d-b9f1c79b89b0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] HTTP exception thrown: Instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 could not be found. Dec 15 19:14:00.577230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6bbc9e0d-295b-4f87-be4d-b9f1c79b89b0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Returning 404 to user: Instance 688fbf24-7c98-4e51-8d6d-3a9f84044719 could not be found. {{(pid=116514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:14:00.578050 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6bbc9e0d-295b-4f87-be4d-b9f1c79b89b0 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719" status: 404 len: 111 microversion: 2.1 time: 0.027175 Dec 15 19:14:00.578554 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 692/1313] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:00 2021] GET /compute/v2.1/servers/688fbf24-7c98-4e51-8d6d-3a9f84044719 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:14:02.071581 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-da1f5857-51d8-4821-a282-41803dc66073 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] Calling method '.version_select at 0x7f80b5a6c160>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:02.176547 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-da1f5857-51d8-4821-a282-41803dc66073 tempest-TestVolumeBootPattern-385992416 tempest-TestVolumeBootPattern-385992416-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-782438899" status: 202 len: 0 microversion: 2.1 time: 0.108132 Dec 15 19:14:02.177071 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 622/1314] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Dec 15 19:14:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-782438899 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:14:23.589586 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-94989551-ef60-47b1-ac0e-2770ce37ab53 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:14:23.590195 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-94989551-ef60-47b1-ac0e-2770ce37ab53 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:23.595993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-94989551-ef60-47b1-ac0e-2770ce37ab53 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:23.597049 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-94989551-ef60-47b1-ac0e-2770ce37ab53 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:23.598213 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-94989551-ef60-47b1-ac0e-2770ce37ab53 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:23.598316 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-94989551-ef60-47b1-ac0e-2770ce37ab53 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:23.620338 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.objects.instance [None req-94989551-ef60-47b1-ac0e-2770ce37ab53 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lazy-loading 'flavor' on Instance uuid 6128c912-1a49-4e44-add6-bcd197f85063 {{(pid=116514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 19:14:23.906146 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-94989551-ef60-47b1-ac0e-2770ce37ab53 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "POST /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063/action" status: 202 len: 0 microversion: 2.1 time: 0.320172 Dec 15 19:14:23.906708 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 693/1315] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:14:23 2021] POST /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:14:23.915899 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-ebd5d3a1-ddbc-4d51-a011-5fc07515eab5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:23.916524 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-ebd5d3a1-ddbc-4d51-a011-5fc07515eab5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:23.923196 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebd5d3a1-ddbc-4d51-a011-5fc07515eab5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:23.927713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebd5d3a1-ddbc-4d51-a011-5fc07515eab5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:23.927713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebd5d3a1-ddbc-4d51-a011-5fc07515eab5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:23.927713 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-ebd5d3a1-ddbc-4d51-a011-5fc07515eab5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:24.063235 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-ebd5d3a1-ddbc-4d51-a011-5fc07515eab5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:24.071214 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-ebd5d3a1-ddbc-4d51-a011-5fc07515eab5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.159478 Dec 15 19:14:24.071779 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 623/1316] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:23 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:25.090230 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7fa25a30-87ed-42b9-b089-a87aa60d6d7f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:25.090976 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-7fa25a30-87ed-42b9-b089-a87aa60d6d7f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:25.097668 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7fa25a30-87ed-42b9-b089-a87aa60d6d7f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:25.098108 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7fa25a30-87ed-42b9-b089-a87aa60d6d7f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:25.098875 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7fa25a30-87ed-42b9-b089-a87aa60d6d7f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:25.099302 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-7fa25a30-87ed-42b9-b089-a87aa60d6d7f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:25.228970 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-7fa25a30-87ed-42b9-b089-a87aa60d6d7f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:25.236444 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7fa25a30-87ed-42b9-b089-a87aa60d6d7f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.150708 Dec 15 19:14:25.237008 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 694/1317] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:25 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:26.253625 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-7fbffc07-a245-4350-9c55-0fac604f6904 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:26.254233 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-7fbffc07-a245-4350-9c55-0fac604f6904 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:26.260506 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7fbffc07-a245-4350-9c55-0fac604f6904 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:26.260951 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7fbffc07-a245-4350-9c55-0fac604f6904 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:26.261768 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7fbffc07-a245-4350-9c55-0fac604f6904 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:26.262194 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-7fbffc07-a245-4350-9c55-0fac604f6904 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:26.391020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-7fbffc07-a245-4350-9c55-0fac604f6904 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:26.398558 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-7fbffc07-a245-4350-9c55-0fac604f6904 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.148597 Dec 15 19:14:26.399122 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 624/1318] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:26 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:27.415529 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-6cb406ae-8750-432a-905c-7b9964d122f9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:27.416060 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-6cb406ae-8750-432a-905c-7b9964d122f9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:27.422273 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6cb406ae-8750-432a-905c-7b9964d122f9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:27.423510 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6cb406ae-8750-432a-905c-7b9964d122f9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:27.423510 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6cb406ae-8750-432a-905c-7b9964d122f9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:27.423902 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-6cb406ae-8750-432a-905c-7b9964d122f9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:27.552907 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-6cb406ae-8750-432a-905c-7b9964d122f9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:27.560352 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-6cb406ae-8750-432a-905c-7b9964d122f9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.148602 Dec 15 19:14:27.560915 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 695/1319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:27 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:28.577988 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-a554d675-586c-436b-a7a4-dd4efa48ac66 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:28.578509 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-a554d675-586c-436b-a7a4-dd4efa48ac66 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:28.584735 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a554d675-586c-436b-a7a4-dd4efa48ac66 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:28.585210 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a554d675-586c-436b-a7a4-dd4efa48ac66 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:28.585976 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a554d675-586c-436b-a7a4-dd4efa48ac66 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:28.586410 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-a554d675-586c-436b-a7a4-dd4efa48ac66 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:28.713339 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-a554d675-586c-436b-a7a4-dd4efa48ac66 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:28.720580 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-a554d675-586c-436b-a7a4-dd4efa48ac66 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.146369 Dec 15 19:14:28.721159 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 625/1320] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:28 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:14:29.739097 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f6d03f65-2608-4b95-b5d3-d5ed7c56f7ab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:29.739708 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f6d03f65-2608-4b95-b5d3-d5ed7c56f7ab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:29.746144 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f6d03f65-2608-4b95-b5d3-d5ed7c56f7ab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:29.746597 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f6d03f65-2608-4b95-b5d3-d5ed7c56f7ab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:29.747378 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f6d03f65-2608-4b95-b5d3-d5ed7c56f7ab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:29.747815 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f6d03f65-2608-4b95-b5d3-d5ed7c56f7ab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:29.882015 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f6d03f65-2608-4b95-b5d3-d5ed7c56f7ab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:29.889342 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f6d03f65-2608-4b95-b5d3-d5ed7c56f7ab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.154374 Dec 15 19:14:29.889908 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 696/1321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:29 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:30.906126 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-31f3a95a-3424-407a-b9ef-0bf86a1238b0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:30.906740 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-31f3a95a-3424-407a-b9ef-0bf86a1238b0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:30.913439 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-31f3a95a-3424-407a-b9ef-0bf86a1238b0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:30.913671 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-31f3a95a-3424-407a-b9ef-0bf86a1238b0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:30.914478 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-31f3a95a-3424-407a-b9ef-0bf86a1238b0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:30.914915 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-31f3a95a-3424-407a-b9ef-0bf86a1238b0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:31.052382 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-31f3a95a-3424-407a-b9ef-0bf86a1238b0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:31.059903 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-31f3a95a-3424-407a-b9ef-0bf86a1238b0 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.157568 Dec 15 19:14:31.060710 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 626/1322] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:30 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:14:32.078083 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-28d3a4b1-d4e1-4534-9421-4a14bde27cab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:32.078659 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-28d3a4b1-d4e1-4534-9421-4a14bde27cab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:32.084998 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-28d3a4b1-d4e1-4534-9421-4a14bde27cab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:32.085492 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-28d3a4b1-d4e1-4534-9421-4a14bde27cab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:32.086271 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-28d3a4b1-d4e1-4534-9421-4a14bde27cab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:32.086710 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-28d3a4b1-d4e1-4534-9421-4a14bde27cab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:32.217274 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-28d3a4b1-d4e1-4534-9421-4a14bde27cab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:32.225110 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-28d3a4b1-d4e1-4534-9421-4a14bde27cab tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.150770 Dec 15 19:14:32.225679 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 697/1323] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:32 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:33.242974 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-13b98cfd-b493-4309-9d78-b8b2caa602a2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:33.243591 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-13b98cfd-b493-4309-9d78-b8b2caa602a2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:33.249976 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-13b98cfd-b493-4309-9d78-b8b2caa602a2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:33.250429 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-13b98cfd-b493-4309-9d78-b8b2caa602a2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:33.251221 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-13b98cfd-b493-4309-9d78-b8b2caa602a2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:33.251661 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-13b98cfd-b493-4309-9d78-b8b2caa602a2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:33.381095 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-13b98cfd-b493-4309-9d78-b8b2caa602a2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:33.388667 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-13b98cfd-b493-4309-9d78-b8b2caa602a2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.149212 Dec 15 19:14:33.389191 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 627/1324] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:33 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:34.406260 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d1a382b6-90ad-4fee-b854-585698aaa89c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:34.406994 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d1a382b6-90ad-4fee-b854-585698aaa89c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:34.413600 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1a382b6-90ad-4fee-b854-585698aaa89c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:34.414137 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1a382b6-90ad-4fee-b854-585698aaa89c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:34.415006 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1a382b6-90ad-4fee-b854-585698aaa89c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:34.415602 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d1a382b6-90ad-4fee-b854-585698aaa89c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:34.633564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d1a382b6-90ad-4fee-b854-585698aaa89c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:34.641061 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d1a382b6-90ad-4fee-b854-585698aaa89c tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.238481 Dec 15 19:14:34.641659 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 698/1325] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:34 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:35.658670 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b6743b44-8e6f-4a1f-a337-b4a88f049ed7 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:35.659281 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b6743b44-8e6f-4a1f-a337-b4a88f049ed7 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:35.666084 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b6743b44-8e6f-4a1f-a337-b4a88f049ed7 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:35.666533 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b6743b44-8e6f-4a1f-a337-b4a88f049ed7 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:35.667305 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b6743b44-8e6f-4a1f-a337-b4a88f049ed7 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:35.667738 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b6743b44-8e6f-4a1f-a337-b4a88f049ed7 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:35.800541 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b6743b44-8e6f-4a1f-a337-b4a88f049ed7 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:35.807918 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b6743b44-8e6f-4a1f-a337-b4a88f049ed7 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.152912 Dec 15 19:14:35.808474 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 628/1326] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:35 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:36.824844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-325f41b0-dc53-464f-a8ae-139b6356cdd6 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:36.825484 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-325f41b0-dc53-464f-a8ae-139b6356cdd6 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:36.831782 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-325f41b0-dc53-464f-a8ae-139b6356cdd6 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:36.832224 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-325f41b0-dc53-464f-a8ae-139b6356cdd6 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:36.832993 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-325f41b0-dc53-464f-a8ae-139b6356cdd6 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:36.833471 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-325f41b0-dc53-464f-a8ae-139b6356cdd6 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:36.964322 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-325f41b0-dc53-464f-a8ae-139b6356cdd6 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:36.971556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-325f41b0-dc53-464f-a8ae-139b6356cdd6 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.150313 Dec 15 19:14:36.972146 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 699/1327] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:36 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:37.989333 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-12006c3c-6857-4e71-b983-e11798d9ab43 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:37.990498 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-12006c3c-6857-4e71-b983-e11798d9ab43 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:37.996633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-12006c3c-6857-4e71-b983-e11798d9ab43 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:37.997075 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-12006c3c-6857-4e71-b983-e11798d9ab43 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:37.997867 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-12006c3c-6857-4e71-b983-e11798d9ab43 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:37.998301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-12006c3c-6857-4e71-b983-e11798d9ab43 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:38.126536 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-12006c3c-6857-4e71-b983-e11798d9ab43 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:38.134516 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-12006c3c-6857-4e71-b983-e11798d9ab43 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1508 microversion: 2.1 time: 0.148921 Dec 15 19:14:38.135089 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 629/1328] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:37 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:38.150629 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-59e5c168-1865-4b82-bc33-eac0d28ec75f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:14:38.151200 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-59e5c168-1865-4b82-bc33-eac0d28ec75f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:38.157409 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-59e5c168-1865-4b82-bc33-eac0d28ec75f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:38.157861 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-59e5c168-1865-4b82-bc33-eac0d28ec75f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:38.158639 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-59e5c168-1865-4b82-bc33-eac0d28ec75f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:38.159082 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-59e5c168-1865-4b82-bc33-eac0d28ec75f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:38.407001 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59e5c168-1865-4b82-bc33-eac0d28ec75f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [13bd3a54-5a44-4ded-a4dd-173b1aa2f0ea] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 19:14:39.423279 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO oslo.messaging._drivers.impl_rabbit [None req-59e5c168-1865-4b82-bc33-eac0d28ec75f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [13bd3a54-5a44-4ded-a4dd-173b1aa2f0ea] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 59794. Dec 15 19:14:39.426270 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-59e5c168-1865-4b82-bc33-eac0d28ec75f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "POST /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063/action" status: 202 len: 0 microversion: 2.1 time: 1.279385 Dec 15 19:14:39.426877 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 700/1329] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Dec 15 19:14:38 2021] POST /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063/action => generated 0 bytes in 1281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:14:39.434702 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-3f7793b1-f255-4a16-8ecb-5fd8c4967685 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:39.435313 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-3f7793b1-f255-4a16-8ecb-5fd8c4967685 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:39.441557 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f7793b1-f255-4a16-8ecb-5fd8c4967685 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:39.442009 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f7793b1-f255-4a16-8ecb-5fd8c4967685 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:39.442787 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f7793b1-f255-4a16-8ecb-5fd8c4967685 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:39.443389 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-3f7793b1-f255-4a16-8ecb-5fd8c4967685 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:39.577689 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-3f7793b1-f255-4a16-8ecb-5fd8c4967685 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:39.585944 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-3f7793b1-f255-4a16-8ecb-5fd8c4967685 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1516 microversion: 2.1 time: 0.154856 Dec 15 19:14:39.586518 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 630/1330] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:39 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:40.169558 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [req-ee7cadcb-c743-4e4f-ad1c-86576625d3dd req-4c421493-baec-434a-88a0-90a4b0f85132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6128c912-1a49-4e44-add6-bcd197f85063", "name": "network-vif-unplugged", "status": "completed", "tag": "1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9"}]} {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:14:40.171372 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:14:40.171372 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: warnings.warn(msg) Dec 15 19:14:40.179413 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-ee7cadcb-c743-4e4f-ad1c-86576625d3dd req-4c421493-baec-434a-88a0-90a4b0f85132 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:40.179860 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [req-ee7cadcb-c743-4e4f-ad1c-86576625d3dd req-4c421493-baec-434a-88a0-90a4b0f85132 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:40.189883 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.compute.server_external_events [req-ee7cadcb-c743-4e4f-ad1c-86576625d3dd req-4c421493-baec-434a-88a0-90a4b0f85132 service nova] Unable to find a host for instance 6128c912-1a49-4e44-add6-bcd197f85063. Dropping event network-vif-unplugged {{(pid=116514) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 19:14:40.190751 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [req-ee7cadcb-c743-4e4f-ad1c-86576625d3dd req-4c421493-baec-434a-88a0-90a4b0f85132 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.140079 Dec 15 19:14:40.192079 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 701/1331] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:14:40 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 142 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 15 19:14:40.603024 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4a0363bf-5afc-439a-a4c3-c3b7cceadf10 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:40.603630 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4a0363bf-5afc-439a-a4c3-c3b7cceadf10 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:40.610189 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4a0363bf-5afc-439a-a4c3-c3b7cceadf10 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:40.610633 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4a0363bf-5afc-439a-a4c3-c3b7cceadf10 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:40.611407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4a0363bf-5afc-439a-a4c3-c3b7cceadf10 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:40.611839 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4a0363bf-5afc-439a-a4c3-c3b7cceadf10 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:40.754981 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4a0363bf-5afc-439a-a4c3-c3b7cceadf10 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:40.762409 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4a0363bf-5afc-439a-a4c3-c3b7cceadf10 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1516 microversion: 2.1 time: 0.163577 Dec 15 19:14:40.762965 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 631/1332] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:40 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:41.780149 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-65a50580-3d72-4a55-8439-c61bbda855c5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:41.780680 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-65a50580-3d72-4a55-8439-c61bbda855c5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:41.787023 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-65a50580-3d72-4a55-8439-c61bbda855c5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:41.787477 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-65a50580-3d72-4a55-8439-c61bbda855c5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:41.788254 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-65a50580-3d72-4a55-8439-c61bbda855c5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:41.788690 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-65a50580-3d72-4a55-8439-c61bbda855c5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:42.162584 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-65a50580-3d72-4a55-8439-c61bbda855c5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:42.169986 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-65a50580-3d72-4a55-8439-c61bbda855c5 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1518 microversion: 2.1 time: 0.393783 Dec 15 19:14:42.170556 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 702/1333] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:41 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1518 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:43.187510 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-9703a5bd-c29a-4561-8724-440ec6990b3f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:43.188999 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-9703a5bd-c29a-4561-8724-440ec6990b3f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:43.195025 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9703a5bd-c29a-4561-8724-440ec6990b3f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:43.195545 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9703a5bd-c29a-4561-8724-440ec6990b3f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:43.196411 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9703a5bd-c29a-4561-8724-440ec6990b3f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:43.196897 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-9703a5bd-c29a-4561-8724-440ec6990b3f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:43.330211 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-9703a5bd-c29a-4561-8724-440ec6990b3f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:43.339271 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-9703a5bd-c29a-4561-8724-440ec6990b3f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1574 microversion: 2.1 time: 0.155242 Dec 15 19:14:43.339860 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 632/1334] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:43 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:44.357229 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b30a0cb2-815e-4de8-bd28-cdd569f2518a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:44.357844 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b30a0cb2-815e-4de8-bd28-cdd569f2518a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:44.364156 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b30a0cb2-815e-4de8-bd28-cdd569f2518a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:44.364609 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b30a0cb2-815e-4de8-bd28-cdd569f2518a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:44.365437 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b30a0cb2-815e-4de8-bd28-cdd569f2518a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:44.365876 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b30a0cb2-815e-4de8-bd28-cdd569f2518a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:44.494217 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-b30a0cb2-815e-4de8-bd28-cdd569f2518a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:44.501462 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b30a0cb2-815e-4de8-bd28-cdd569f2518a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1574 microversion: 2.1 time: 0.148468 Dec 15 19:14:44.502023 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 703/1335] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:44 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:45.518930 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-b7c47616-1435-4552-81d7-9605fb794408 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:45.519571 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-b7c47616-1435-4552-81d7-9605fb794408 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:45.525919 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b7c47616-1435-4552-81d7-9605fb794408 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:45.526366 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b7c47616-1435-4552-81d7-9605fb794408 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:45.527142 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b7c47616-1435-4552-81d7-9605fb794408 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:45.527575 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-b7c47616-1435-4552-81d7-9605fb794408 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:45.658241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-b7c47616-1435-4552-81d7-9605fb794408 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:45.667663 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-b7c47616-1435-4552-81d7-9605fb794408 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1574 microversion: 2.1 time: 0.152403 Dec 15 19:14:45.668225 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 633/1336] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:45 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:46.686010 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-f48cffa5-6e3b-4071-b6c2-1ebed0615308 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:46.686821 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-f48cffa5-6e3b-4071-b6c2-1ebed0615308 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:46.693107 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f48cffa5-6e3b-4071-b6c2-1ebed0615308 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:46.693564 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f48cffa5-6e3b-4071-b6c2-1ebed0615308 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:46.694868 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f48cffa5-6e3b-4071-b6c2-1ebed0615308 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:46.695304 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-f48cffa5-6e3b-4071-b6c2-1ebed0615308 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:46.927607 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-f48cffa5-6e3b-4071-b6c2-1ebed0615308 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:46.935425 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-f48cffa5-6e3b-4071-b6c2-1ebed0615308 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1574 microversion: 2.1 time: 0.254310 Dec 15 19:14:46.935995 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 704/1337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:46 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1574 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:47.953241 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-04cbfee5-4c79-4e4f-ab8e-827312e82ec8 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:47.953781 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-04cbfee5-4c79-4e4f-ab8e-827312e82ec8 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:47.960591 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04cbfee5-4c79-4e4f-ab8e-827312e82ec8 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:47.961054 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04cbfee5-4c79-4e4f-ab8e-827312e82ec8 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:47.961862 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04cbfee5-4c79-4e4f-ab8e-827312e82ec8 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:47.962301 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-04cbfee5-4c79-4e4f-ab8e-827312e82ec8 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:48.090487 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-04cbfee5-4c79-4e4f-ab8e-827312e82ec8 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:48.097747 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-04cbfee5-4c79-4e4f-ab8e-827312e82ec8 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1574 microversion: 2.1 time: 0.148364 Dec 15 19:14:48.098308 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 634/1338] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:47 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:49.115368 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-dbe1a5c0-32b5-4c9b-9395-995857a6ce31 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:49.115948 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-dbe1a5c0-32b5-4c9b-9395-995857a6ce31 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:49.122337 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dbe1a5c0-32b5-4c9b-9395-995857a6ce31 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:49.122782 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dbe1a5c0-32b5-4c9b-9395-995857a6ce31 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:49.123545 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dbe1a5c0-32b5-4c9b-9395-995857a6ce31 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:49.123970 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-dbe1a5c0-32b5-4c9b-9395-995857a6ce31 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:49.252576 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-dbe1a5c0-32b5-4c9b-9395-995857a6ce31 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:49.259984 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-dbe1a5c0-32b5-4c9b-9395-995857a6ce31 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1574 microversion: 2.1 time: 0.148291 Dec 15 19:14:49.260554 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 705/1339] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:49 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:50.277351 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-73779037-71cf-41d7-817c-5c82cb5c74e2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:50.277953 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-73779037-71cf-41d7-817c-5c82cb5c74e2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:50.284488 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-73779037-71cf-41d7-817c-5c82cb5c74e2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:50.284927 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-73779037-71cf-41d7-817c-5c82cb5c74e2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:50.285727 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-73779037-71cf-41d7-817c-5c82cb5c74e2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:50.286154 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-73779037-71cf-41d7-817c-5c82cb5c74e2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:50.424407 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-73779037-71cf-41d7-817c-5c82cb5c74e2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:50.432306 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-73779037-71cf-41d7-817c-5c82cb5c74e2 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1574 microversion: 2.1 time: 0.158675 Dec 15 19:14:50.432874 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 635/1340] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:50 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:51.449799 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-de663b11-ac1b-4b1c-9e1e-5f20251dd14f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:51.450337 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-de663b11-ac1b-4b1c-9e1e-5f20251dd14f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:51.456541 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de663b11-ac1b-4b1c-9e1e-5f20251dd14f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:51.456988 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de663b11-ac1b-4b1c-9e1e-5f20251dd14f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:51.457803 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de663b11-ac1b-4b1c-9e1e-5f20251dd14f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:51.458239 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-de663b11-ac1b-4b1c-9e1e-5f20251dd14f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:51.590696 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-de663b11-ac1b-4b1c-9e1e-5f20251dd14f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:51.598091 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-de663b11-ac1b-4b1c-9e1e-5f20251dd14f tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1574 microversion: 2.1 time: 0.152052 Dec 15 19:14:51.598666 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 706/1341] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:51 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:52.089439 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-0bc2a480-c95f-407a-bfe6-511f520db8c6 req-a18405f0-6a5f-4081-a77c-17fb62730c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6128c912-1a49-4e44-add6-bcd197f85063", "name": "network-vif-plugged", "status": "completed", "tag": "1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:14:52.091026 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:14:52.091026 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:14:52.098533 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-0bc2a480-c95f-407a-bfe6-511f520db8c6 req-a18405f0-6a5f-4081-a77c-17fb62730c82 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:52.102284 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-0bc2a480-c95f-407a-bfe6-511f520db8c6 req-a18405f0-6a5f-4081-a77c-17fb62730c82 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:52.110870 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-0bc2a480-c95f-407a-bfe6-511f520db8c6 req-a18405f0-6a5f-4081-a77c-17fb62730c82 service nova] Creating event network-vif-plugged:1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9 for instance 6128c912-1a49-4e44-add6-bcd197f85063 on hv-cinder-81268 Dec 15 19:14:52.115809 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-0bc2a480-c95f-407a-bfe6-511f520db8c6 req-a18405f0-6a5f-4081-a77c-17fb62730c82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030670 Dec 15 19:14:52.116381 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 636/1342] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:14:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:14:52.615277 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-8dad6cfc-47a3-4765-bc10-fc3be9b13177 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:52.615883 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-8dad6cfc-47a3-4765-bc10-fc3be9b13177 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:52.622262 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8dad6cfc-47a3-4765-bc10-fc3be9b13177 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:52.622709 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8dad6cfc-47a3-4765-bc10-fc3be9b13177 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:52.623486 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8dad6cfc-47a3-4765-bc10-fc3be9b13177 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:52.623918 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-8dad6cfc-47a3-4765-bc10-fc3be9b13177 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:52.753573 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-8dad6cfc-47a3-4765-bc10-fc3be9b13177 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:52.763512 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-8dad6cfc-47a3-4765-bc10-fc3be9b13177 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1574 microversion: 2.1 time: 0.151877 Dec 15 19:14:52.764078 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 707/1343] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:52 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:14:53.784843 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-4c2d9273-267a-454a-9229-1bb3ee670e24 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:14:53.785584 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-4c2d9273-267a-454a-9229-1bb3ee670e24 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:14:53.792636 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c2d9273-267a-454a-9229-1bb3ee670e24 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:53.793106 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c2d9273-267a-454a-9229-1bb3ee670e24 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:53.793886 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c2d9273-267a-454a-9229-1bb3ee670e24 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:14:53.794320 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-4c2d9273-267a-454a-9229-1bb3ee670e24 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:14:53.923769 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-4c2d9273-267a-454a-9229-1bb3ee670e24 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:14:53.931155 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-4c2d9273-267a-454a-9229-1bb3ee670e24 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1561 microversion: 2.1 time: 0.151973 Dec 15 19:14:53.931723 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 637/1344] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:14:53 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:15:14.187725 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:15:14.188383 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: Wed Dec 15 19:15:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:16:10.636941 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-b74dc4bc-d190-4952-a22a-42f867ada68a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:16:10.637540 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b74dc4bc-d190-4952-a22a-42f867ada68a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:16:10.643740 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b74dc4bc-d190-4952-a22a-42f867ada68a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:10.644443 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b74dc4bc-d190-4952-a22a-42f867ada68a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:10.645664 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b74dc4bc-d190-4952-a22a-42f867ada68a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:10.645891 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-b74dc4bc-d190-4952-a22a-42f867ada68a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:10.671405 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-b74dc4bc-d190-4952-a22a-42f867ada68a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Going to try to terminate instance {{(pid=116514) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 19:16:10.703212 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-71176736-7278-45de-8aa4-352e237740ac req-e35fbed5-6997-4628-87b4-c3bb928c0f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6128c912-1a49-4e44-add6-bcd197f85063", "tag": "1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:16:10.704772 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:16:10.704772 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:16:10.712038 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-71176736-7278-45de-8aa4-352e237740ac req-e35fbed5-6997-4628-87b4-c3bb928c0f6a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:10.712490 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-71176736-7278-45de-8aa4-352e237740ac req-e35fbed5-6997-4628-87b4-c3bb928c0f6a service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:10.723157 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-71176736-7278-45de-8aa4-352e237740ac req-e35fbed5-6997-4628-87b4-c3bb928c0f6a service nova] Creating event network-changed:1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9 for instance 6128c912-1a49-4e44-add6-bcd197f85063 on hv-cinder-81268 Dec 15 19:16:10.728217 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-71176736-7278-45de-8aa4-352e237740ac req-e35fbed5-6997-4628-87b4-c3bb928c0f6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089538 Dec 15 19:16:10.728804 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 638/1345] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:16:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:16:10.943960 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-b74dc4bc-d190-4952-a22a-42f867ada68a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 204 len: 0 microversion: 2.1 time: 0.311936 Dec 15 19:16:10.944610 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 708/1346] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Dec 15 19:16:10 2021] DELETE /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 19:16:10.953687 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-df07c42b-75fb-4411-85ca-d90a159bc94a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:16:10.954386 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-df07c42b-75fb-4411-85ca-d90a159bc94a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:16:10.960741 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-df07c42b-75fb-4411-85ca-d90a159bc94a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:10.961457 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-df07c42b-75fb-4411-85ca-d90a159bc94a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:10.962244 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-df07c42b-75fb-4411-85ca-d90a159bc94a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:10.962669 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-df07c42b-75fb-4411-85ca-d90a159bc94a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:11.106712 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.policy [None req-df07c42b-75fb-4411-85ca-d90a159bc94a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116515) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:16:11.114890 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-df07c42b-75fb-4411-85ca-d90a159bc94a tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1567 microversion: 2.1 time: 0.165120 Dec 15 19:16:11.115950 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 639/1347] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:16:10 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 19:16:12.133981 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-d355cfcd-a6ac-4bf0-a96e-a30ca99f13e9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:16:12.134683 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-d355cfcd-a6ac-4bf0-a96e-a30ca99f13e9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:16:12.140912 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d355cfcd-a6ac-4bf0-a96e-a30ca99f13e9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:12.141399 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d355cfcd-a6ac-4bf0-a96e-a30ca99f13e9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:12.142209 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d355cfcd-a6ac-4bf0-a96e-a30ca99f13e9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:12.142645 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-d355cfcd-a6ac-4bf0-a96e-a30ca99f13e9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:12.277722 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-d355cfcd-a6ac-4bf0-a96e-a30ca99f13e9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:16:12.290003 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-d355cfcd-a6ac-4bf0-a96e-a30ca99f13e9 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1449 microversion: 2.1 time: 0.159408 Dec 15 19:16:12.290591 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 709/1348] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:16:12 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:16:13.099307 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [req-e0283b59-8c67-41b8-9460-6bf48111a99d req-412e6b1d-06d8-4d36-8b5a-1ede5b7ad713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6128c912-1a49-4e44-add6-bcd197f85063", "name": "network-vif-deleted", "tag": "1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9"}]} {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 19:16:13.100794 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 19:16:13.100794 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: warnings.warn(msg) Dec 15 19:16:13.108512 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-e0283b59-8c67-41b8-9460-6bf48111a99d req-412e6b1d-06d8-4d36-8b5a-1ede5b7ad713 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:13.108963 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [req-e0283b59-8c67-41b8-9460-6bf48111a99d req-412e6b1d-06d8-4d36-8b5a-1ede5b7ad713 service nova] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:13.121392 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.compute.server_external_events [req-e0283b59-8c67-41b8-9460-6bf48111a99d req-412e6b1d-06d8-4d36-8b5a-1ede5b7ad713 service nova] Creating event network-vif-deleted:1394d9c1-4ca6-4a9a-b01f-4ce1ffaa8ee9 for instance 6128c912-1a49-4e44-add6-bcd197f85063 on hv-cinder-81268 Dec 15 19:16:13.126121 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [req-e0283b59-8c67-41b8-9460-6bf48111a99d req-412e6b1d-06d8-4d36-8b5a-1ede5b7ad713 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083206 Dec 15 19:16:13.126704 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 640/1349] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Dec 15 19:16:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 19:16:13.308864 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-4780404c-0e7d-4556-8ee4-707fda636254 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:16:13.309579 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.compute.api [None req-4780404c-0e7d-4556-8ee4-707fda636254 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116514) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:16:13.316775 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4780404c-0e7d-4556-8ee4-707fda636254 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:13.317264 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4780404c-0e7d-4556-8ee4-707fda636254 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:13.318066 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4780404c-0e7d-4556-8ee4-707fda636254 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:13.318500 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG oslo_concurrency.lockutils [None req-4780404c-0e7d-4556-8ee4-707fda636254 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:13.389763 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.policy [None req-4780404c-0e7d-4556-8ee4-707fda636254 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd2bd6bc5a94874a286d6deafb9f1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78f14ed60c847cb8e006926cc936940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116514) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 19:16:13.397523 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-4780404c-0e7d-4556-8ee4-707fda636254 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 200 len: 1220 microversion: 2.1 time: 0.092713 Dec 15 19:16:13.398103 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 710/1350] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:16:13 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 19:16:14.415946 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-db8562a0-247d-4d91-a22a-de44536c4a74 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '>' {{(pid=116515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:16:14.416591 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.compute.api [None req-db8562a0-247d-4d91-a22a-de44536c4a74 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] [instance: 6128c912-1a49-4e44-add6-bcd197f85063] Fetching instance by UUID {{(pid=116515) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 19:16:14.422698 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-db8562a0-247d-4d91-a22a-de44536c4a74 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:14.423147 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-db8562a0-247d-4d91-a22a-de44536c4a74 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:14.423933 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-db8562a0-247d-4d91-a22a-de44536c4a74 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 19:16:14.424479 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG oslo_concurrency.lockutils [None req-db8562a0-247d-4d91-a22a-de44536c4a74 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Lock "415a2223-155c-4f3b-b9fc-3b76c07aa9ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116515) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 19:16:14.437556 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.wsgi [None req-db8562a0-247d-4d91-a22a-de44536c4a74 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] HTTP exception thrown: Instance 6128c912-1a49-4e44-add6-bcd197f85063 could not be found. Dec 15 19:16:14.441935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: DEBUG nova.api.openstack.wsgi [None req-db8562a0-247d-4d91-a22a-de44536c4a74 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Returning 404 to user: Instance 6128c912-1a49-4e44-add6-bcd197f85063 could not be found. {{(pid=116515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 19:16:14.441935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO nova.api.openstack.requestlog [None req-db8562a0-247d-4d91-a22a-de44536c4a74 tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063" status: 404 len: 111 microversion: 2.1 time: 0.028465 Dec 15 19:16:14.441935 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: [pid: 116515|app: 0|req: 641/1351] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Dec 15 19:16:14 2021] GET /compute/v2.1/servers/6128c912-1a49-4e44-add6-bcd197f85063 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 19:16:14.665454 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: DEBUG nova.api.openstack.wsgi [None req-7edac98e-50dc-4538-8edb-2fa55071392b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] Calling method '.version_select at 0x7f80b63cd310>' {{(pid=116514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 19:16:14.810267 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO nova.api.openstack.requestlog [None req-7edac98e-50dc-4538-8edb-2fa55071392b tempest-TestShelveInstance-933522876 tempest-TestShelveInstance-933522876-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2000091582" status: 202 len: 0 microversion: 2.1 time: 0.148910 Dec 15 19:16:14.810858 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: [pid: 116514|app: 0|req: 711/1352] 10.222.0.49 () {58 vars in 1253 bytes} [Wed Dec 15 19:16:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2000091582 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 19:17:00.208694 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:17:00.209318 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: Wed Dec 15 19:17:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:18:19.077653 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:18:19.078267 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: Wed Dec 15 19:18:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:18:34.205451 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:18:34.206020 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: Wed Dec 15 19:18:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:18:50.586440 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:18:50.587107 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: Wed Dec 15 19:18:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:18:59.605125 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:18:59.606242 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: Wed Dec 15 19:18:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:20:13.860088 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:20:13.860744 dv-cinder-812685-5-iscsi devstack@n-api.service[116514]: Wed Dec 15 19:20:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 19:20:20.226320 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 19:20:20.226921 dv-cinder-812685-5-iscsi devstack@n-api.service[116515]: Wed Dec 15 19:20:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!